-- Logs begin at Mon 2021-08-30 07:05:41 UTC, end at Mon 2021-08-30 08:14:04 UTC. -- Aug 30 07:39:06.342774 dv-cinder-806191-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 07:39:06.353244 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 30 07:39:06 2021] *** Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: nodename: dv-cinder-806191-3-iscsi Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: machine: x86_64 Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: clock source: unix Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: pcre jit disabled Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: detected number of CPU cores: 4 Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: current working directory: / Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: detected binary path: /usr/bin/uwsgi-core Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: your processes number limit is 47680 Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: your memory page size is 4096 bytes Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: detected max file descriptor number: 2048 Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: lock engine: pthread robust mutexes Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: thunder lock: enabled Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 07:39:06.355345 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 30 07:39:06.398760 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: Python main interpreter initialized at 0x55ba8ec129c0 Aug 30 07:39:06.398760 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: python threads support enabled Aug 30 07:39:06.398760 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: your server socket listen backlog is limited to 100 connections Aug 30 07:39:06.398760 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: your mercy for graceful operations on workers is 90 seconds Aug 30 07:39:06.399146 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 07:39:06.399146 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: *** Operational MODE: preforking *** Aug 30 07:39:06.399432 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: *** uWSGI is running in multiple interpreter mode *** Aug 30 07:39:06.399432 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: spawned uWSGI master process (pid: 99681) Aug 30 07:39:06.399638 dv-cinder-806191-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 07:39:06.401160 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: spawned uWSGI worker 1 (pid: 99682, cores: 1) Aug 30 07:39:06.401160 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: spawned uWSGI worker 2 (pid: 99683, cores: 1) Aug 30 07:39:06.401160 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 07:39:08.052304 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 07:39:08.052304 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: from cryptography.utils import int_from_bytes Aug 30 07:39:08.052966 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 07:39:08.052966 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: from cryptography.utils import int_from_bytes Aug 30 07:39:08.053099 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 07:39:08.053099 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: from cryptography.utils import int_from_bytes Aug 30 07:39:08.053099 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 07:39:08.053099 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: from cryptography.utils import int_from_bytes Aug 30 07:39:10.730164 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 07:39:10.730728 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 07:39:10.730873 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 07:39:10.731236 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 07:39:10.731490 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 07:39:10.731582 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 07:39:10.731963 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 07:39:10.732064 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.732187 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.732274 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 07:39:10.732508 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.732598 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 07:39:10.732822 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 07:39:10.732921 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.733252 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.733470 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.733622 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.733761 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.733908 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.734108 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.734308 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.734472 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.734612 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.734774 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.734938 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.735070 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.735187 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.735429 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.735547 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.735759 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.735859 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806191-3-iscsi {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.736021 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.736131 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.736334 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.736438 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.736660 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806191-3-iscsi {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.736763 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.736983 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.737077 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.737294 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.737416 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.737603 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.737696 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.737911 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.738014 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.738229 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.738435 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.738552 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.738852 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.738954 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.739161 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.739360 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.739468 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.739805 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.739952 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.740044 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.740125 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.740264 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.740384 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.740576 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.740703 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.740887 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.741010 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.741195 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.741331 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.741513 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.741640 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.741817 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.742036 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806191-3-iscsi {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.742124 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.742388 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.742517 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.742703 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.742844 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806191-3-iscsi {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.743017 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.743158 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.743431 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.743561 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.743742 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.743829 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.744050 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.744156 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.744377 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.744477 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.744697 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.744780 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.745004 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.745092 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.745330 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.745427 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.745649 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.745751 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.745967 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.746054 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.746310 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.746402 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.746610 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.746709 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.746917 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.747012 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.747219 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.747306 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.747527 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.747629 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.747827 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.747912 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.748130 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.748217 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.748383 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.748582 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.748709 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.748812 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.749043 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.749138 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.749351 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.749449 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.749671 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.749766 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.749964 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.750070 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.750245 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.750350 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.750561 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.750654 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.750812 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.750916 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.751127 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.751224 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.751447 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.751540 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.751751 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.751850 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.752055 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.752140 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.752359 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.752447 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.752662 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.752756 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.752978 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.753080 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.753265 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.753358 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.753567 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.753657 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.753870 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.753955 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.754206 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.754298 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.754517 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.754607 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.754838 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.754943 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.755143 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.755229 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.755462 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.755556 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.755767 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.755863 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.756095 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.756178 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.756402 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.756488 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.756706 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.756797 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.757025 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.757118 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.757333 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.757421 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.757638 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.757721 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.757943 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.758035 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.758269 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.758368 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.758576 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.758667 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.758895 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.759008 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.759185 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.759269 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.759435 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.759520 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.759766 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.759932 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.760082 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.760224 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.760366 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.760501 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.760644 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.760785 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.760924 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.761058 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.761191 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.761327 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.761470 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.761612 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.761754 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.761907 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.762043 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.762196 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.762349 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.762495 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.762656 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.762795 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.762963 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.763100 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.763249 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.763392 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.763537 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.763672 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.763842 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.763980 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.764145 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.764288 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.765002 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.765136 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.765325 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.765469 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.765634 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.765767 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.766227 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.766355 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.766536 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.766667 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.766841 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.766975 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.767162 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.767260 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.767465 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.767561 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.767769 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.767864 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.768086 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.768181 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.768390 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.768483 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.768694 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.768792 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.769007 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.769101 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.769313 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.769409 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.769615 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.769760 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.769919 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.770050 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.770242 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.770346 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.770547 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.770641 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.770845 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.770930 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.771149 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.771243 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.771451 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.771537 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.771751 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.771837 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.772052 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.772148 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.772351 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.772436 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.772654 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.772741 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.772952 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.773046 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.773252 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.773337 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.773549 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.773641 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.773852 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.773947 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.774165 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.774264 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.774487 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.774583 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.774791 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.774877 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.775094 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.775180 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.775399 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.775485 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.775703 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.775800 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.776022 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:39:10.776115 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.776357 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.776442 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.776681 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.776767 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.777013 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.777099 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.777324 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.777426 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.777648 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.777748 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.777961 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.778068 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.778299 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.778418 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.778629 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.778732 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.778942 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.779047 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.779249 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.779348 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.779558 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.779643 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.779870 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.779963 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.780746 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.780846 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.781067 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.781159 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.781385 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.781500 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.781700 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.781798 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.782017 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.782110 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.782350 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.782439 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.782671 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.782771 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.782979 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.783064 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.783298 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.783385 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.783606 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.783693 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.783931 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.784018 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.784243 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.784329 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.784576 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.784663 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.784905 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.784991 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.785214 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.785299 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.785533 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.785623 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.785841 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.785934 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.786195 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.786287 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.786486 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.786575 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.786795 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.786881 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.787106 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.787200 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.787415 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.787502 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.787724 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.787809 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.788034 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.788128 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.788354 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.788440 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.788662 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.788756 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.788973 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.789103 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.789277 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.789374 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.789588 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.789700 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.789892 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.790001 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.790213 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.790327 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.790520 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.790615 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.790833 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.790929 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.791156 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.791251 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.791461 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.791548 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.791771 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.791858 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.792083 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.792170 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.792391 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.792484 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.792699 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.792786 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.793005 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.793091 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.793308 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.793394 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.793619 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.793716 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.793919 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.794006 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.794253 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.794346 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.794563 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.794651 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.794867 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.794964 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.795171 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.795296 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.795517 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.795613 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.795820 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.795913 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.796132 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.796333 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.796445 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.796654 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.796770 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.796972 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.797083 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.797288 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.797375 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.797615 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.797708 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.797930 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.798016 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.798264 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.798357 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.798602 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.798690 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.798936 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.799052 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.799259 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.799346 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.799556 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.799644 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.799864 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.799962 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.800170 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.800264 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.800476 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.800566 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.800781 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.800881 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.801083 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.801169 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.801385 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.801470 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.801689 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.801784 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.801993 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.802080 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.802322 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.802412 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.802629 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.802728 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.802936 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.803028 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.803244 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.803331 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.803548 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.803642 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.803849 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.803943 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.804151 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.804237 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.804454 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.804547 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.804756 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.804843 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.805061 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.805155 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.805402 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.805490 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.805709 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.805803 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.806049 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.806135 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.806389 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.806477 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.806709 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.806795 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.807023 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.807110 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.807333 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.807426 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.807643 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.807729 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.807953 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.808048 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.808267 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.808362 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.808576 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.808671 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.808886 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.808981 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.809195 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.809290 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.809505 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.809592 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.809814 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.809908 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.810125 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.810232 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.810452 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.810538 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.810767 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.810865 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.811088 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.811728 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.811938 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.812037 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.812255 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.812365 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.812581 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.812676 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.812894 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.812988 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.813211 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.813315 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.813521 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.813615 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.813840 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.813947 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.814179 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.814276 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.814488 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.814582 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.814809 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.814903 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.815121 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.815222 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.815435 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.815542 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.815746 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.815833 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.816055 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.816143 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.816366 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.816498 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.816678 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.816765 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.816982 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.817069 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.817297 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.817390 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.817615 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.817714 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.817923 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.818022 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.818259 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.818362 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.818572 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.818667 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.818893 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.818980 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.819206 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.819300 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.819517 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.819611 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.819826 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.819912 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.820132 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.820218 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.820436 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.820529 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.820744 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.820836 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.821047 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.821140 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.821352 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.821447 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.821657 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.821751 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.821962 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.822049 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.822289 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.822381 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.822600 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.822689 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.822900 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.822987 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.823205 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.823294 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.823511 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.823597 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.823814 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.823902 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.824117 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.824256 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.824426 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.824521 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.824745 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.824840 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.825046 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.825139 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.825351 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.825445 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.825673 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.825814 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.825975 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.826113 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.826289 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.826418 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.826587 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.826735 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.827449 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.827756 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.827889 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.828029 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.828164 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.828307 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.828459 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.828601 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.828738 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.828881 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.829017 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.829228 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.829365 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.829499 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.829584 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.829787 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.829874 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.830099 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.830220 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.830437 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.830525 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.830763 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.830910 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.831076 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.831232 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.831384 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.831528 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.831694 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.831844 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.831988 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.832123 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.832295 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.832446 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.832604 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.832749 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.832917 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.833054 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.833208 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.833343 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.833519 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.833670 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.833828 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.833971 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.834129 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.834322 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.834467 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.834620 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.834757 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.834892 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.835126 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.835329 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.835477 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.835666 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.835986 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.836123 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.836307 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.836447 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.836622 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.836766 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.836939 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.837077 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.837258 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.837429 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.837571 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.837661 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.837885 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.837971 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.838213 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.838318 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.838525 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.838612 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.838834 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.838922 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.839142 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.839237 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.839450 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.839575 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.839753 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.839838 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.840059 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.840155 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.840359 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.840454 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.840664 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.840758 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.840966 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.841061 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.841273 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.841366 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.841576 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.841670 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.841877 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.841978 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.842212 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.842302 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.842561 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.842732 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.842895 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.843072 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.843214 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.843392 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.843515 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.843715 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.843834 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.844026 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.844141 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.844354 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.844444 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.844669 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.844757 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.844976 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.845062 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.845283 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.845371 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.845588 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.845682 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.845931 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.846022 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.846265 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.846371 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.846608 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.846695 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.846939 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.847035 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.847260 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.847347 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.847567 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.847655 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.847874 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.847972 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.848174 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.848261 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.848484 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.848573 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.848787 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.848889 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.849087 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.849179 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.849394 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.849487 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.849701 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.849797 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.850002 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.850098 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.850335 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.850424 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.850640 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.850744 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.850946 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.851033 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.851248 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.851334 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.851550 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.851643 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.851854 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.851941 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.852156 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.852243 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.852454 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.852541 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.852762 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.852849 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.853078 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.853189 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.853369 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.853457 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.853674 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.853764 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.853973 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.854059 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.854296 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.854386 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.854607 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.854709 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.854908 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.855006 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.855210 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.855297 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.855511 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.855597 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.855814 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.855953 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.856116 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.856203 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.856424 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.856509 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.856733 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.856864 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.857034 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.857121 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.857342 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.857430 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.857648 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.857744 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.857951 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.858037 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.858309 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.858408 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.858633 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.858825 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.858949 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.859137 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.859253 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.859452 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.859547 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.859780 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.859868 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.860098 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.860192 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.860405 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.860505 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.860717 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.860804 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.861019 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.861105 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.861321 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.861414 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.861618 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.861711 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.861923 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.862010 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.862248 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.862354 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.862556 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.862643 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.862862 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.862956 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.863161 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.863255 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.863464 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.863551 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.863771 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.863864 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.864084 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.864172 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.864388 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.864475 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.864691 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.864781 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.864994 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.865082 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.865338 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.865437 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.865644 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.865732 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.865952 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.866038 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.866311 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.866405 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.866627 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.866766 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.866932 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.867020 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.867244 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.867331 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.867555 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.867641 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.867866 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.867953 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.868170 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.868315 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.868460 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.868608 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.868763 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.868899 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.869079 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.869225 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.869384 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.869531 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.869688 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.869826 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.870011 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.870168 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.870346 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.870491 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.870660 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.870809 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.870970 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.871102 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.871281 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.871423 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.871593 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.871728 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.871896 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.872036 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.872205 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.872345 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.872513 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.872646 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.872823 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.872958 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.873134 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.873266 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.873443 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.873576 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.874326 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.874496 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.874675 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.874861 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.874999 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.875136 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.875271 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.875418 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.875562 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.875697 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.875854 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.875994 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.876167 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.876312 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.876465 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.876606 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.876766 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.876913 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.877076 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.877210 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.877387 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.877474 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.877691 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.877785 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.878000 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.878104 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.878330 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.878464 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.878640 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.878778 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.878947 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.879086 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.879371 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.879461 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.879685 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.879772 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.879997 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.880139 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.880304 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.880393 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.880614 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.880701 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.880928 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.881038 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.881243 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.881357 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.881557 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.881671 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.881863 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.881984 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.882302 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.882396 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.882610 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.882697 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.882920 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.883009 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.883231 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.883318 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.883537 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.883623 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.883844 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.883938 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.884153 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.884239 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.884475 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.884562 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.884778 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.884866 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.885082 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.885175 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.885386 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.885505 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.885710 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.885805 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.886015 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.886102 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.886364 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.886553 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.886779 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.886867 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.887092 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.887223 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.887399 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.887496 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.887786 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.887872 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.888111 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.888198 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.888418 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.888514 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.888734 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.888821 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.889046 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.889132 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.889418 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.890067 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.890274 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.890411 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.890541 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.890680 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.890855 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.891262 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.891440 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.891572 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.891764 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.891899 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.892078 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.892225 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.892394 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.892541 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.892700 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.892864 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.893024 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.893282 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.893369 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.893609 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.893695 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.893923 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.894014 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.894274 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.894389 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.894604 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.894770 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.894899 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.895016 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.895206 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.895338 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.895520 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.895663 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.895827 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.895971 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.896132 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.896278 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.896455 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.896589 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.896763 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.896894 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.897074 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.897199 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.897387 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.897522 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.897698 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.897828 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.898005 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.898139 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.898346 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.898472 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.898671 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.898783 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.898975 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.899109 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.899298 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.899387 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.899612 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.899698 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.899936 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.900031 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.900257 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.900380 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.900565 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.900700 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.900889 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.900977 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.901199 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.901293 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.901502 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.901597 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.901803 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.901890 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.902109 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.902299 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.902437 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.902536 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.902742 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.902840 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.903048 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.903135 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.903391 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.903488 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.903703 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.903790 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.904012 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.904101 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.904340 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.904427 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.904667 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.904753 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.905000 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.905090 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.905320 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.905415 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.905643 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.905737 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.905949 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.906043 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.906280 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.906372 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.906594 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.906684 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.906897 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.906984 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.907198 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.907285 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.907504 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.907595 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.907807 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.907907 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.908109 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.908195 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.908411 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.908497 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.908712 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.908803 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.909013 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.909090 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.909315 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.909391 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.909618 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.909703 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.909937 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.910012 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.910262 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.910353 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.910632 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.910739 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.910870 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.910959 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.911173 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.911266 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.911477 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.911574 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.911782 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.911870 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.912125 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.912220 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.912432 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.912511 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.912762 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.912852 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.913075 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.913162 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.913397 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.913483 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.913711 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.913797 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.914028 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.914105 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.914374 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.914466 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.914690 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.914784 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.915003 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.915139 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.915316 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.915413 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.915629 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.915716 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.915941 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.916042 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.916255 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.916341 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.916569 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.916656 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.916876 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.916971 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.917191 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.917437 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.917533 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.917778 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.917878 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.918099 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.918374 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.918476 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.918713 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.918802 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.919034 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.919135 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.919353 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.919441 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.919670 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.919747 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.919992 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.920115 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.920306 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.920395 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.920757 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.920866 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.921056 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.921307 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.921694 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.921837 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.921938 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.922019 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.922113 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.922306 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.922388 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.922479 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.922700 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.922961 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.922961 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.923127 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.923195 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.923270 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.923514 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.923691 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.923864 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.923957 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.924168 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.924280 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.924562 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.924655 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.924877 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.924985 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.925211 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.925294 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.925384 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.925624 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.925773 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.925933 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.926019 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.926274 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.926382 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.926775 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.926970 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.927061 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.927144 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.927239 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.927323 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.927494 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.928052 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.928146 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.928228 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.928318 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.928402 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.928483 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.928562 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.928709 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.928807 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.929037 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.929136 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.929351 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.929446 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.929681 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.929917 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.930013 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.930318 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.930431 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.930635 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.930722 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.930972 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.931196 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.931375 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.931513 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.931605 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.931847 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.931949 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.932176 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.932264 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.932500 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.932596 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.932808 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.932910 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.933123 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.933212 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.933436 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.933523 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.933744 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.933843 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.934050 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.934138 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.934389 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.934478 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.934694 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.934782 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.934998 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.935085 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.935317 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.935413 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.935678 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.935855 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.935984 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.936733 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.936962 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.937114 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.937240 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.937583 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.937783 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.937906 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.938136 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.938275 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.938470 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.938568 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.938799 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.938886 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.939106 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.939206 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.939416 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.939503 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.939726 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.939812 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.940038 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.940136 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.940343 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.940450 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.940648 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.940733 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.940962 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.941066 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.941271 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.941357 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.941574 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.941659 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.941877 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.941970 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.942207 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.942381 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.942534 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.942675 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.942826 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.942967 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.943105 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.943245 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.943385 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.943524 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.943719 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.943867 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.944022 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.944160 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.944299 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.944447 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.944595 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.944736 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.944905 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.945052 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.945191 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.945328 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.945500 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.945654 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.945795 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.945951 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.946091 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.946284 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.946447 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.946596 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.946750 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.946897 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.947155 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.947319 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.947450 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.947536 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.947617 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.947704 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.947898 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.947995 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.948211 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.948311 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.948513 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.948602 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.948833 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.948965 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.949132 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.949220 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.949438 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.949526 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.949753 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.949864 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.950061 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.950197 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.950408 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.950497 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.950723 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.950977 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.951078 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.951312 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.951400 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.951656 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.951767 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.952615 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.952880 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.952985 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.953219 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.953403 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.953556 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.953713 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.953906 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.954002 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.954286 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.954384 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.954600 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.954692 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.954908 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.955039 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.955215 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.955308 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.955541 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.955630 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.955854 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.955950 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.956166 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.956264 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.956476 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.956562 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.956785 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.956871 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.957095 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.957256 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.957402 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.957533 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.957711 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.957798 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.958018 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.958115 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.958356 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.958457 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.958668 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.958757 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.958983 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.959073 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.959298 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.959385 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.959612 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.959700 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.959924 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.960029 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.960240 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.960353 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.960553 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.960648 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.960866 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.960969 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.961177 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.961271 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.961491 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.961582 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.961794 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.961893 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.962108 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.962462 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.962554 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.962778 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.962869 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.963084 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.963175 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.963432 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.963746 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.963845 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.964060 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.964151 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.964382 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.964472 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.965195 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.965282 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.965282 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.965415 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.965492 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.965582 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.965662 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.965740 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.965916 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.966011 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.966260 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.966364 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.966574 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.966667 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.966896 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.966982 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.967203 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.967314 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.967547 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.967727 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.967876 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.967978 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.968182 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.968299 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.968489 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.968576 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.968795 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.968903 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.969104 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.969217 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.969439 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.969542 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.969756 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.969870 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.970124 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.970241 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.970474 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.970569 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.970792 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.970878 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.971100 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.971185 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.971421 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.971534 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.971729 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.971814 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.972044 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.972131 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.972349 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.972434 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.972659 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.972753 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.972971 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.973066 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.973280 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.973365 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.973593 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.973690 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.973906 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.973993 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.974235 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.974385 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.974544 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.974639 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.974870 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.974957 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.975189 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.975275 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.975492 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.975600 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.975804 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.975890 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.976116 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.976202 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.976436 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.976522 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.976750 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.976842 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.977057 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.977143 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.977388 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.977477 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.977727 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.977827 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.977981 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.978078 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.978315 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.978403 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.978629 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.978733 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.978948 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.979058 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.979261 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.979355 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.979587 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.979696 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.979912 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.980007 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.980280 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.980380 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.980560 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.980654 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.980802 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 07:39:10.980898 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.981205 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.981549 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.981877 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:39:10.982120 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 07:39:11.004127 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_db.sqlalchemy.engines [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:39:11.005047 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG oslo_db.sqlalchemy.engines [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:39:11.083673 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.context [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14de09d5-e436-48df-b23e-2bee56c910cd(cell1) {{(pid=99682) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 07:39:11.083885 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.context [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14de09d5-e436-48df-b23e-2bee56c910cd(cell1) {{(pid=99683) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 07:39:11.087909 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG oslo_concurrency.lockutils [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:39:11.088039 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:39:11.089464 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:39:11.089569 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG oslo_concurrency.lockutils [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:39:11.090283 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:39:11.090392 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG oslo_concurrency.lockutils [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:39:11.092206 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:39:11.092309 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG oslo_concurrency.lockutils [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:39:11.197028 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG oslo_db.sqlalchemy.engines [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:39:11.199697 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG oslo_db.sqlalchemy.engines [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:39:11.202982 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_db.sqlalchemy.engines [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:39:11.205111 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_db.sqlalchemy.engines [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:39:11.464856 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_db.sqlalchemy.engines [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:39:11.467830 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG oslo_db.sqlalchemy.engines [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:39:11.809951 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: WARNING keystonemiddleware.auth_token [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 07:39:11.810617 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: WARNING keystonemiddleware.auth_token [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 07:39:11.816574 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: WARNING keystonemiddleware.auth_token [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 07:39:11.816702 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: WARNING keystonemiddleware.auth_token [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 07:39:12.160240 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: WARNING keystonemiddleware.auth_token [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 07:39:12.161737 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: WARNING keystonemiddleware.auth_token [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 07:39:12.165355 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: WARNING keystonemiddleware.auth_token [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 07:39:12.166835 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: WARNING keystonemiddleware.auth_token [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 07:39:12.171480 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ba8ec129c0 pid: 99683 (default app) Aug 30 07:39:12.173008 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ba8ec129c0 pid: 99682 (default app) Aug 30 07:39:12.173267 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:39:12.174493 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-88a5e201-3af5-41dd-8f1e-a92869419733 None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Aug 30 07:39:12.174890 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 789 bytes} [Mon Aug 30 07:39:12 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:40:34.089781 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:40:34.092091 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003048 Aug 30 07:40:34.093151 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:40:34 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:40:34.827382 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-2b2d43d5-af80-4ed2-af1f-03db766c5450 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:40:34.881162 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-2b2d43d5-af80-4ed2-af1f-03db766c5450 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.779355 Aug 30 07:40:34.882353 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 2/3] 10.222.0.73 () {60 vars in 1292 bytes} [Mon Aug 30 07:40:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:40:38.051364 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:40:38.053818 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-2dba8b89-63cb-4ef9-874b-dafc38e99af7 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003050 Aug 30 07:40:38.065988 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 2/4] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:40:38 2021] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:40:38.178312 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-d89a02f5-b290-4e2d-9cc6-3f22a7cb6a34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "ram": 256, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "vcpus": 1}} {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:38.213244 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:40:38.213244 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: warnings.warn(msg) Aug 30 07:40:38.269138 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-d89a02f5-b290-4e2d-9cc6-3f22a7cb6a34 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.201050 Aug 30 07:40:38.270532 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 3/5] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 30 07:40:38 2021] POST /compute/v2.1/flavors => generated 407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:40:38.725175 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-2cc9cf41-37d9-48bf-a630-74d2eb348dd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:38.728970 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:40:38.728970 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: warnings.warn(msg) Aug 30 07:40:38.829904 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-2cc9cf41-37d9-48bf-a630-74d2eb348dd4 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.543215 Aug 30 07:40:38.831244 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 3/6] 10.222.0.73 () {64 vars in 1336 bytes} [Mon Aug 30 07:40:38 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:40:41.391759 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-d89a02f5-b290-4e2d-9cc6-3f22a7cb6a34 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:40:41.394567 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-d89a02f5-b290-4e2d-9cc6-3f22a7cb6a34 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003407 Aug 30 07:40:41.395313 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 4/7] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:40:41 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:40:41.607915 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-342c0f0c-75c3-4af1-b1c4-8e3fbbfb9d9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d1", "disk": 5}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:41.648101 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:40:41.648101 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: warnings.warn(msg) Aug 30 07:40:41.686203 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-342c0f0c-75c3-4af1-b1c4-8e3fbbfb9d9e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.278593 Aug 30 07:40:41.688015 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 4/8] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 30 07:40:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:40:41.707594 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-fba1310c-f6e3-497d-acbd-3c5126aa333c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:41.711831 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:40:41.711831 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: warnings.warn(msg) Aug 30 07:40:41.782346 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-fba1310c-f6e3-497d-acbd-3c5126aa333c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083022 Aug 30 07:40:41.784419 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 5/9] 10.222.0.73 () {64 vars in 1336 bytes} [Mon Aug 30 07:40:41 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:40:44.935959 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-342c0f0c-75c3-4af1-b1c4-8e3fbbfb9d9e admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:40:44.937006 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-342c0f0c-75c3-4af1-b1c4-8e3fbbfb9d9e admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 30 07:40:44.937974 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:40:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:40:45.043011 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-a51b3737-a521-46a0-a4de-e675e2f11792 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "vcpus": 1, "ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:45.069834 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-a51b3737-a521-46a0-a4de-e675e2f11792 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.123502 Aug 30 07:40:45.071126 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 6/11] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 30 07:40:44 2021] POST /compute/v2.1/flavors => generated 404 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:40:45.103211 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-124aea6f-4ac8-4797-9cdf-07170b578fa4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:45.148140 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-124aea6f-4ac8-4797-9cdf-07170b578fa4 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052826 Aug 30 07:40:45.149170 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 6/12] 10.222.0.73 () {64 vars in 1336 bytes} [Mon Aug 30 07:40:45 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:40:47.914931 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-a51b3737-a521-46a0-a4de-e675e2f11792 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:40:47.916726 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-a51b3737-a521-46a0-a4de-e675e2f11792 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002601 Aug 30 07:40:47.917685 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 7/13] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:40:47 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:40:48.010626 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-e06c39ce-824f-4b4f-ae49-b283656c5a31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:48.037154 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-e06c39ce-824f-4b4f-ae49-b283656c5a31 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.107526 Aug 30 07:40:48.038869 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 7/14] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 30 07:40:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:40:48.058227 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-3b632924-a3ac-4abc-9711-35d4ef1709ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:48.097494 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-3b632924-a3ac-4abc-9711-35d4ef1709ed admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044893 Aug 30 07:40:48.099251 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 8/15] 10.222.0.73 () {64 vars in 1336 bytes} [Mon Aug 30 07:40:48 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:40:51.154102 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-e06c39ce-824f-4b4f-ae49-b283656c5a31 admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:40:51.155260 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-e06c39ce-824f-4b4f-ae49-b283656c5a31 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Aug 30 07:40:51.155659 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 8/16] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:40:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:40:51.271017 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-8d729150-291c-42d0-835f-921399f944ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "disk": 20}} {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:51.308953 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-8d729150-291c-42d0-835f-921399f944ec admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144950 Aug 30 07:40:51.310344 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 9/17] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 30 07:40:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:40:51.328060 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-628e8656-a359-4dd1-9306-ca8d2da0e4ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:51.376324 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-628e8656-a359-4dd1-9306-ca8d2da0e4ae admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055810 Aug 30 07:40:51.377993 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 9/18] 10.222.0.73 () {64 vars in 1336 bytes} [Mon Aug 30 07:40:51 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:40:54.392533 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-8d729150-291c-42d0-835f-921399f944ec admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:40:54.394445 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-8d729150-291c-42d0-835f-921399f944ec admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002566 Aug 30 07:40:54.395143 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 10/19] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:40:54 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:40:54.512599 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-90fec220-3df9-4148-988d-0542cdb1067b admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:40:54.543320 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-90fec220-3df9-4148-988d-0542cdb1067b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.135906 Aug 30 07:40:54.544349 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 10/20] 10.222.0.73 () {60 vars in 1292 bytes} [Mon Aug 30 07:40:54 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:40:57.111566 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-8d729150-291c-42d0-835f-921399f944ec admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:40:57.112916 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-8d729150-291c-42d0-835f-921399f944ec admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002235 Aug 30 07:40:57.113426 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 11/21] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:40:57 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:40:57.232289 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-ec6f4acc-38a7-4c47-9454-4d551a870607 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny"}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:57.267355 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-ec6f4acc-38a7-4c47-9454-4d551a870607 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.142015 Aug 30 07:40:57.268416 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 11/22] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 30 07:40:57 2021] POST /compute/v2.1/flavors => generated 402 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:40:57.283632 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-02c1fcd2-8eef-4de0-9d7f-cfd7f435a0a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:40:57.312472 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-02c1fcd2-8eef-4de0-9d7f-cfd7f435a0a0 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032982 Aug 30 07:40:57.312987 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 12/23] 10.222.0.73 () {64 vars in 1333 bytes} [Mon Aug 30 07:40:57 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:41:00.436479 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-ec6f4acc-38a7-4c47-9454-4d551a870607 admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:00.438291 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-ec6f4acc-38a7-4c47-9454-4d551a870607 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002465 Aug 30 07:41:00.439056 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 12/24] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:41:00 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:41:00.547277 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-c0a5ec57-d061-45c2-8038-70caba379420 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:41:00.579420 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-c0a5ec57-d061-45c2-8038-70caba379420 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.131084 Aug 30 07:41:00.581170 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 13/25] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 30 07:41:00 2021] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:41:00.602015 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-174dd892-7cf3-4901-8019-37b1327c0a94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:41:00.633937 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-174dd892-7cf3-4901-8019-37b1327c0a94 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035684 Aug 30 07:41:00.635267 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 13/26] 10.222.0.73 () {64 vars in 1333 bytes} [Mon Aug 30 07:41:00 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:41:03.383035 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-c0a5ec57-d061-45c2-8038-70caba379420 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:03.384067 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-c0a5ec57-d061-45c2-8038-70caba379420 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001766 Aug 30 07:41:03.384481 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 14/27] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:41:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:41:03.464359 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-2c4cb350-d00b-4821-b4db-4cefbd27394e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "ram": 4096}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:41:03.487836 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-2c4cb350-d00b-4821-b4db-4cefbd27394e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.095961 Aug 30 07:41:03.488636 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 14/28] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 30 07:41:03 2021] POST /compute/v2.1/flavors => generated 406 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:41:03.502387 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-a32409ec-255f-4695-9f4c-1cffb4a37031 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:41:03.531849 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-a32409ec-255f-4695-9f4c-1cffb4a37031 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033328 Aug 30 07:41:03.532463 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 15/29] 10.222.0.73 () {64 vars in 1333 bytes} [Mon Aug 30 07:41:03 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:41:06.158491 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-2c4cb350-d00b-4821-b4db-4cefbd27394e admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:06.161413 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-2c4cb350-d00b-4821-b4db-4cefbd27394e admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003615 Aug 30 07:41:06.162178 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 15/30] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:41:06 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:41:06.258603 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-00716d7d-dfb6-4294-aebb-0cc2391c35f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "id": "4"}} {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:41:06.288110 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-00716d7d-dfb6-4294-aebb-0cc2391c35f9 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.118414 Aug 30 07:41:06.289235 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 16/31] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 30 07:41:06 2021] POST /compute/v2.1/flavors => generated 405 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:41:06.307983 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-99045e55-d347-49be-909b-891b19525d62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:41:06.362606 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-99045e55-d347-49be-909b-891b19525d62 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060581 Aug 30 07:41:06.363791 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 16/32] 10.222.0.73 () {64 vars in 1333 bytes} [Mon Aug 30 07:41:06 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:41:09.752939 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-00716d7d-dfb6-4294-aebb-0cc2391c35f9 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:09.755399 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-00716d7d-dfb6-4294-aebb-0cc2391c35f9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003144 Aug 30 07:41:09.755905 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 17/33] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:41:09 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:41:09.831763 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-d7b4101b-319f-4284-83bd-0924c1112d5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:41:09.852829 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-d7b4101b-319f-4284-83bd-0924c1112d5b admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.088863 Aug 30 07:41:09.853405 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 17/34] 10.222.0.73 () {64 vars in 1283 bytes} [Mon Aug 30 07:41:09 2021] POST /compute/v2.1/flavors => generated 408 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:41:09.870806 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-1711f1f1-7ac9-4fdf-8f99-35a4b9a0ba00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:41:09.906138 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-1711f1f1-7ac9-4fdf-8f99-35a4b9a0ba00 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040673 Aug 30 07:41:09.906967 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 18/35] 10.222.0.73 () {64 vars in 1333 bytes} [Mon Aug 30 07:41:09 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:41:50.018886 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-d7b4101b-319f-4284-83bd-0924c1112d5b admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:50.020395 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-d7b4101b-319f-4284-83bd-0924c1112d5b admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Aug 30 07:41:50.020961 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 18/36] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:41:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:41:50.090093 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-9e6cab74-91b9-422c-af83-5d81daf4948c admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:50.121280 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-9e6cab74-91b9-422c-af83-5d81daf4948c admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.091754 Aug 30 07:41:50.121838 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 19/37] 10.222.0.73 () {60 vars in 1292 bytes} [Mon Aug 30 07:41:50 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:41:51.631877 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-d7b4101b-319f-4284-83bd-0924c1112d5b admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:51.632989 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-d7b4101b-319f-4284-83bd-0924c1112d5b admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001813 Aug 30 07:41:51.633485 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 19/38] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:41:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:41:51.835741 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-d7ab77df-3ae3-46f7-bfff-f59987753ac9 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:51.842301 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.wsgi [None req-d7ab77df-3ae3-46f7-bfff-f59987753ac9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 07:41:51.842945 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-d7ab77df-3ae3-46f7-bfff-f59987753ac9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=99683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:41:51.843819 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-d7ab77df-3ae3-46f7-bfff-f59987753ac9 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.068742 Aug 30 07:41:51.844428 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 20/39] 10.222.0.73 () {60 vars in 1191 bytes} [Mon Aug 30 07:41:51 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 07:41:51.855006 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-d6957c2e-1f16-41d4-b7c1-ebe84f837aac admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:51.878481 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-d6957c2e-1f16-41d4-b7c1-ebe84f837aac admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026978 Aug 30 07:41:51.879664 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 20/40] 10.222.0.73 () {60 vars in 1211 bytes} [Mon Aug 30 07:41:51 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:41:51.891285 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-42de1930-809b-46e1-9a05-c66302cc9d42 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:51.913915 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-42de1930-809b-46e1-9a05-c66302cc9d42 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026433 Aug 30 07:41:51.914523 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 21/41] 10.222.0.73 () {60 vars in 1211 bytes} [Mon Aug 30 07:41:51 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:41:51.930578 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-5f871599-a533-4887-8496-d4e8b01298b4 admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:51.939960 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.wsgi [None req-5f871599-a533-4887-8496-d4e8b01298b4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 07:41:51.940950 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-5f871599-a533-4887-8496-d4e8b01298b4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=99682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:41:51.943819 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-5f871599-a533-4887-8496-d4e8b01298b4 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.021894 Aug 30 07:41:51.944824 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 21/42] 10.222.0.73 () {60 vars in 1191 bytes} [Mon Aug 30 07:41:51 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 07:41:53.415865 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-42de1930-809b-46e1-9a05-c66302cc9d42 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:53.416886 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-42de1930-809b-46e1-9a05-c66302cc9d42 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 30 07:41:53.417290 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 22/43] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:41:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:41:53.612807 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-1e84c19c-e6d8-439b-8055-2d27bf5443d6 admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:53.619115 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.wsgi [None req-1e84c19c-e6d8-439b-8055-2d27bf5443d6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 07:41:53.619687 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-1e84c19c-e6d8-439b-8055-2d27bf5443d6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=99682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:41:53.620537 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-1e84c19c-e6d8-439b-8055-2d27bf5443d6 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.062105 Aug 30 07:41:53.621029 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 22/44] 10.222.0.73 () {60 vars in 1191 bytes} [Mon Aug 30 07:41:53 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 07:41:53.633646 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-77cb6730-7b97-4dca-a6b2-5554df2199ec admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:53.649812 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-77cb6730-7b97-4dca-a6b2-5554df2199ec admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.021973 Aug 30 07:41:53.650486 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 23/45] 10.222.0.73 () {60 vars in 1211 bytes} [Mon Aug 30 07:41:53 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:41:53.661462 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-3a74a2d6-b410-488a-8d7a-64cc4f2bea0a admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:53.675119 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-3a74a2d6-b410-488a-8d7a-64cc4f2bea0a admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017789 Aug 30 07:41:53.676469 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 23/46] 10.222.0.73 () {60 vars in 1211 bytes} [Mon Aug 30 07:41:53 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:41:53.687578 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-07262f20-349c-403f-88a7-9ef114c121f7 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:53.693784 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.wsgi [None req-07262f20-349c-403f-88a7-9ef114c121f7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 07:41:53.694397 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-07262f20-349c-403f-88a7-9ef114c121f7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=99683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:41:53.695203 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-07262f20-349c-403f-88a7-9ef114c121f7 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.011707 Aug 30 07:41:53.695735 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 24/47] 10.222.0.73 () {60 vars in 1191 bytes} [Mon Aug 30 07:41:53 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 07:41:55.167274 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-3a74a2d6-b410-488a-8d7a-64cc4f2bea0a admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:55.168441 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-3a74a2d6-b410-488a-8d7a-64cc4f2bea0a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Aug 30 07:41:55.168903 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 24/48] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:41:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:41:55.367915 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-a6fe4820-84d2-4589-b5d0-71f6fb999765 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:55.374245 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.wsgi [None req-a6fe4820-84d2-4589-b5d0-71f6fb999765 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 07:41:55.374771 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-a6fe4820-84d2-4589-b5d0-71f6fb999765 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=99683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:41:55.375584 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-a6fe4820-84d2-4589-b5d0-71f6fb999765 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.064866 Aug 30 07:41:55.376192 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 25/49] 10.222.0.73 () {60 vars in 1194 bytes} [Mon Aug 30 07:41:55 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 07:41:55.387089 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-c3d16998-27f1-42a0-b245-365833d7eed0 admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:55.401496 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-c3d16998-27f1-42a0-b245-365833d7eed0 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017932 Aug 30 07:41:55.402064 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 25/50] 10.222.0.73 () {60 vars in 1211 bytes} [Mon Aug 30 07:41:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:41:55.413417 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:55.428812 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.019736 Aug 30 07:41:55.429385 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 26/51] 10.222.0.73 () {60 vars in 1211 bytes} [Mon Aug 30 07:41:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:41:55.440217 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-4fef9e08-df14-422d-b205-311525a53e95 admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:55.446579 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.wsgi [None req-4fef9e08-df14-422d-b205-311525a53e95 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 07:41:55.447245 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-4fef9e08-df14-422d-b205-311525a53e95 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=99682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:41:55.448140 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-4fef9e08-df14-422d-b205-311525a53e95 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.011723 Aug 30 07:41:55.448709 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 26/52] 10.222.0.73 () {60 vars in 1194 bytes} [Mon Aug 30 07:41:55 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 07:41:56.871572 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:56.872715 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Aug 30 07:41:56.873186 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 27/53] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:41:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:41:57.084669 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-682c2269-4d0e-46e2-be25-91406b1186f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:41:57.106544 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-682c2269-4d0e-46e2-be25-91406b1186f4 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.088010 Aug 30 07:41:57.107273 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 27/54] 10.222.0.73 () {64 vars in 1236 bytes} [Mon Aug 30 07:41:57 2021] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:41:58.570983 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:41:58.572000 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 30 07:41:58.572398 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 28/55] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:41:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:41:58.771996 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-82650f03-28b4-4b56-9762-93e956431133 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:41:58.792860 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-82650f03-28b4-4b56-9762-93e956431133 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.079240 Aug 30 07:41:58.793417 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 28/56] 10.222.0.73 () {64 vars in 1236 bytes} [Mon Aug 30 07:41:58 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:42:00.252547 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:42:00.253755 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Aug 30 07:42:00.254247 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 29/57] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:42:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:42:00.488806 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-a8fb3a8c-5a07-44a1-84e3-75f32f7e1568 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:42:00.508206 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-a8fb3a8c-5a07-44a1-84e3-75f32f7e1568 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.078654 Aug 30 07:42:00.508747 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 29/58] 10.222.0.73 () {64 vars in 1236 bytes} [Mon Aug 30 07:42:00 2021] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:42:01.951270 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:42:01.952277 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 30 07:42:01.952679 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 30/59] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:42:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:42:02.154178 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-f19b8f69-379b-4b97-b66a-9e86fcdcd835 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:42:02.174384 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-f19b8f69-379b-4b97-b66a-9e86fcdcd835 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.079371 Aug 30 07:42:02.174847 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 30/60] 10.222.0.73 () {64 vars in 1236 bytes} [Mon Aug 30 07:42:02 2021] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:42:03.601851 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:42:03.602982 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Aug 30 07:42:03.603435 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 31/61] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:42:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:42:03.812219 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-e41eb5a8-34c2-4b9a-b399-ba2225d1a6fe admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:42:03.833686 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-e41eb5a8-34c2-4b9a-b399-ba2225d1a6fe admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.085231 Aug 30 07:42:03.834378 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 31/62] 10.222.0.73 () {60 vars in 1203 bytes} [Mon Aug 30 07:42:03 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:42:51.599777 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:42:51.600791 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-c2a3995e-7844-4366-bdfb-d9b018ecff9a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 30 07:42:51.601189 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 32/63] 10.222.0.73 () {54 vars in 931 bytes} [Mon Aug 30 07:42:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:42:51.672272 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-55154555-d6b2-4d69-a624-785181f5213a admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:42:51.701863 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-55154555-d6b2-4d69-a624-785181f5213a admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.091517 Aug 30 07:42:51.702489 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 32/64] 10.222.0.73 () {60 vars in 1292 bytes} [Mon Aug 30 07:42:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:42:51.728360 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-81a3a8ab-9943-4b0a-9d6a-25af6a65b9a4 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:42:51.737027 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-81a3a8ab-9943-4b0a-9d6a-25af6a65b9a4 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013175 Aug 30 07:42:51.737627 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 33/65] 10.222.0.73 () {60 vars in 1283 bytes} [Mon Aug 30 07:42:51 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:42:51.756384 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-e07abd6f-51c1-4b38-a754-83f016d253eb admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:42:51.764822 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-e07abd6f-51c1-4b38-a754-83f016d253eb admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012551 Aug 30 07:42:51.765414 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 33/66] 10.222.0.73 () {60 vars in 1286 bytes} [Mon Aug 30 07:42:51 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:42:51.778694 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-0b02abb8-73ac-4d6c-bfaa-860599726bd3 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:42:51.787213 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-0b02abb8-73ac-4d6c-bfaa-860599726bd3 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012219 Aug 30 07:42:51.788008 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 34/67] 10.222.0.73 () {60 vars in 1286 bytes} [Mon Aug 30 07:42:51 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:42:51.805259 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-2021ac98-c151-461b-9ef5-b1002a186338 admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:42:51.813441 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-2021ac98-c151-461b-9ef5-b1002a186338 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012870 Aug 30 07:42:51.814011 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 34/68] 10.222.0.73 () {60 vars in 1283 bytes} [Mon Aug 30 07:42:51 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:44:16.128040 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-d6148ca1-3bb9-4cd5-b9b1-34c86556deb4 tempest-verify_tempest_config-907884293 tempest-verify_tempest_config-907884293-project] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:44:16.130085 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-d6148ca1-3bb9-4cd5-b9b1-34c86556deb4 tempest-verify_tempest_config-907884293 tempest-verify_tempest_config-907884293-project] 10.222.0.73 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.122156 Aug 30 07:44:16.130678 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 35/69] 10.222.0.73 () {58 vars in 1134 bytes} [Mon Aug 30 07:44:16 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:45:48.063338 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-2021ac98-c151-461b-9ef5-b1002a186338 admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:45:48.064341 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-2021ac98-c151-461b-9ef5-b1002a186338 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 30 07:45:48.064765 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 35/70] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:45:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:45:48.335412 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-7cd3c14e-ed4d-4e8d-8abd-4d6195149269 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:45:48.336570 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:45:48.336570 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: warnings.warn(msg) Aug 30 07:45:48.338171 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-7cd3c14e-ed4d-4e8d-8abd-4d6195149269 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:45:48.338722 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-7cd3c14e-ed4d-4e8d-8abd-4d6195149269 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:45:48.339509 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-7cd3c14e-ed4d-4e8d-8abd-4d6195149269 admin admin] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:45:48.339934 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-7cd3c14e-ed4d-4e8d-8abd-4d6195149269 admin admin] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:45:48.374859 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-7cd3c14e-ed4d-4e8d-8abd-4d6195149269 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.165895 Aug 30 07:45:48.375439 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 36/71] 10.222.0.73 () {60 vars in 1194 bytes} [Mon Aug 30 07:45:48 2021] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:45:49.761170 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-2021ac98-c151-461b-9ef5-b1002a186338 admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:45:49.762462 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-2021ac98-c151-461b-9ef5-b1002a186338 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001684 Aug 30 07:45:49.762855 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 36/72] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:45:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:45:49.969170 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-7a273845-50b6-467d-ab3f-d91f58bd5f88 admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:45:49.970401 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:45:49.970401 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: warnings.warn(msg) Aug 30 07:45:49.971960 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-7a273845-50b6-467d-ab3f-d91f58bd5f88 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:45:49.972401 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-7a273845-50b6-467d-ab3f-d91f58bd5f88 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:45:49.973174 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-7a273845-50b6-467d-ab3f-d91f58bd5f88 admin admin] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:45:49.973600 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-7a273845-50b6-467d-ab3f-d91f58bd5f88 admin admin] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:45:49.992892 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-7a273845-50b6-467d-ab3f-d91f58bd5f88 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.080970 Aug 30 07:45:49.993456 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 37/73] 10.222.0.73 () {60 vars in 1194 bytes} [Mon Aug 30 07:45:49 2021] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:46:01.800886 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-2021ac98-c151-461b-9ef5-b1002a186338 admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:46:01.801879 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-2021ac98-c151-461b-9ef5-b1002a186338 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 30 07:46:01.802298 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 37/74] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:46:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:46:01.998576 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-761a7e19-3a10-4de1-837d-3799bc73cdbc admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:46:02.000287 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:46:02.000287 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: warnings.warn(msg) Aug 30 07:46:02.001791 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-761a7e19-3a10-4de1-837d-3799bc73cdbc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:46:02.002363 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-761a7e19-3a10-4de1-837d-3799bc73cdbc admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:46:02.003176 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-761a7e19-3a10-4de1-837d-3799bc73cdbc admin admin] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:46:02.003597 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-761a7e19-3a10-4de1-837d-3799bc73cdbc admin admin] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:46:02.028211 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-761a7e19-3a10-4de1-837d-3799bc73cdbc admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.084556 Aug 30 07:46:02.028670 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 38/75] 10.222.0.73 () {60 vars in 1194 bytes} [Mon Aug 30 07:46:01 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:46:03.418813 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: DEBUG nova.api.openstack.wsgi [None req-2021ac98-c151-461b-9ef5-b1002a186338 admin admin] Calling method '>' {{(pid=99682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:46:03.419842 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: INFO nova.api.openstack.requestlog [None req-2021ac98-c151-461b-9ef5-b1002a186338 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 30 07:46:03.420237 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: [pid: 99682|app: 0|req: 38/76] 10.222.0.73 () {56 vars in 1075 bytes} [Mon Aug 30 07:46:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:46:03.616029 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG nova.api.openstack.wsgi [None req-92daf7b5-1189-4915-bbc0-978c70ae2abf admin admin] Calling method '>' {{(pid=99683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:46:03.617200 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:46:03.617200 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: warnings.warn(msg) Aug 30 07:46:03.618756 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-92daf7b5-1189-4915-bbc0-978c70ae2abf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:46:03.619189 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-92daf7b5-1189-4915-bbc0-978c70ae2abf admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:46:03.619961 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-92daf7b5-1189-4915-bbc0-978c70ae2abf admin admin] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:46:03.620409 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: DEBUG oslo_concurrency.lockutils [None req-92daf7b5-1189-4915-bbc0-978c70ae2abf admin admin] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:46:03.642012 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: INFO nova.api.openstack.requestlog [None req-92daf7b5-1189-4915-bbc0-978c70ae2abf admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.081347 Aug 30 07:46:03.642496 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: [pid: 99683|app: 0|req: 39/77] 10.222.0.73 () {60 vars in 1194 bytes} [Mon Aug 30 07:46:03 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:47:03.170196 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: Mon Aug 30 07:47:03 2021 - graceful shutdown triggered... Aug 30 07:47:03.171006 dv-cinder-806191-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 07:47:03.172002 dv-cinder-806191-3-iscsi devstack@n-api.service[99682]: Gracefully killing worker 1 (pid: 99682)... Aug 30 07:47:03.172398 dv-cinder-806191-3-iscsi devstack@n-api.service[99683]: Gracefully killing worker 2 (pid: 99683)... Aug 30 07:47:04.171931 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: worker 1 buried after 1 seconds Aug 30 07:47:04.171931 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: worker 2 buried after 1 seconds Aug 30 07:47:04.171931 dv-cinder-806191-3-iscsi devstack@n-api.service[99681]: goodbye to uWSGI. Aug 30 07:47:04.173482 dv-cinder-806191-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 07:47:04.174030 dv-cinder-806191-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 07:47:04.176862 dv-cinder-806191-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 07:47:04.189461 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 07:47:04.191941 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 30 07:47:04 2021] *** Aug 30 07:47:04.191941 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 07:47:04.191941 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 07:47:04.191941 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: nodename: dv-cinder-806191-3-iscsi Aug 30 07:47:04.191941 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: machine: x86_64 Aug 30 07:47:04.191941 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: clock source: unix Aug 30 07:47:04.191941 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: pcre jit disabled Aug 30 07:47:04.191941 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: detected number of CPU cores: 4 Aug 30 07:47:04.193410 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: current working directory: / Aug 30 07:47:04.193410 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: detected binary path: /usr/bin/uwsgi-core Aug 30 07:47:04.193410 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: your processes number limit is 47680 Aug 30 07:47:04.193410 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: your memory page size is 4096 bytes Aug 30 07:47:04.193410 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: detected max file descriptor number: 2048 Aug 30 07:47:04.193410 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: lock engine: pthread robust mutexes Aug 30 07:47:04.193410 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: thunder lock: enabled Aug 30 07:47:04.193410 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 07:47:04.193410 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 30 07:47:04.240130 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: Python main interpreter initialized at 0x55d6a1e4e9c0 Aug 30 07:47:04.240130 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: python threads support enabled Aug 30 07:47:04.240130 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: your server socket listen backlog is limited to 100 connections Aug 30 07:47:04.240130 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: your mercy for graceful operations on workers is 90 seconds Aug 30 07:47:04.240742 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 07:47:04.240742 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: *** Operational MODE: preforking *** Aug 30 07:47:04.240997 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: *** uWSGI is running in multiple interpreter mode *** Aug 30 07:47:04.240997 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: spawned uWSGI master process (pid: 114652) Aug 30 07:47:04.241030 dv-cinder-806191-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 07:47:04.241630 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: spawned uWSGI worker 1 (pid: 114670, cores: 1) Aug 30 07:47:04.242009 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: spawned uWSGI worker 2 (pid: 114671, cores: 1) Aug 30 07:47:04.243128 dv-cinder-806191-3-iscsi devstack@n-api.service[114652]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 07:47:06.136314 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 07:47:06.136314 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: from cryptography.utils import int_from_bytes Aug 30 07:47:06.137088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 07:47:06.137088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: from cryptography.utils import int_from_bytes Aug 30 07:47:06.301349 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 07:47:06.301349 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: from cryptography.utils import int_from_bytes Aug 30 07:47:06.302103 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 07:47:06.302103 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: from cryptography.utils import int_from_bytes Aug 30 07:47:08.753582 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 07:47:08.754193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 07:47:08.755114 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 07:47:08.755553 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 07:47:08.755811 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 07:47:08.756590 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.757162 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.757498 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.757838 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.758489 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.758828 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.759163 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.760773 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.761125 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.761402 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.761733 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.762074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806191-3-iscsi {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.762431 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.767136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.767136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.767136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.767136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.767136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.767136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.768076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.768076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.768076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.768076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.768076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.768076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.768880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.768880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.768880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.768880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.768880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.769518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806191-3-iscsi {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.769518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.769877 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.770739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.770739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.771232 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.771232 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.771704 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.771956 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.772214 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.772457 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.772783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.773070 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.773393 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.773702 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.774068 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.774371 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.774896 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.775155 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.775397 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.775685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.775915 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.776139 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.776386 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.777535 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.777535 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.777535 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.777535 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.778592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.778592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.778592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.779388 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.779388 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.779818 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.780059 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.780348 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.780732 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.780732 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.781202 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.781406 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.781966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.781966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.782476 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.782711 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.782946 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.783278 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.783599 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.783913 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.784325 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.784565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.784836 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.785356 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.785592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.785841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.786080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.789189 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.789189 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.789696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.789938 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.790219 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.790485 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.790761 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.791076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.791386 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.791698 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.792321 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.792321 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.792901 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.792901 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.793395 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.793622 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.793879 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.794114 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.794650 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.795457 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.796099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.796099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.796523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.796523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.796985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.797233 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.797462 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.797709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.797932 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.798249 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.798571 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.799290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.799290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.799732 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.799959 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.800199 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.800440 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.800673 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.800954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.801256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.801561 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.801866 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.802495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.802495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.802961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.803344 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.803777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.803777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.804239 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.804445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.804689 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.805085 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:08.805315 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.805541 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.806047 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.806337 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.806574 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.806848 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.807175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.807489 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.807810 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.808142 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.808458 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.808774 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.809159 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.809644 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.809867 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.810092 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.810375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.811238 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.811533 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.811847 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.812172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.812716 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.812962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.813200 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.813588 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.813815 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.814085 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.814447 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.814762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.815126 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.815399 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.815715 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.816223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.816456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.816709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.817029 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.817370 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.817793 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.818123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.818481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.818792 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.819102 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.819523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.820073 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.820073 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.820523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.820832 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.821175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.821487 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.821803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.822140 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.822555 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.823101 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.823321 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.823597 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.823996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.824224 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.824437 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.824700 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.825011 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.825384 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.825638 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.825952 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.827154 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.827154 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.827599 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.827815 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.828038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.828366 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.828709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.829019 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.829351 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.829748 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.830309 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.830309 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.830718 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.830957 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.831199 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.831495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.831811 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.832120 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.832428 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.832738 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.833336 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.833336 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.833785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.834044 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.834472 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.834722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.834950 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.835193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.835588 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.835857 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.836198 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.836525 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.836850 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.837595 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.837595 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.838045 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.838045 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.838563 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.838799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.839019 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.839305 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.839630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.840092 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.840662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.840662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.841092 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.841316 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.841544 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.842722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.842963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.843123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.843639 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.843957 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.844279 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.844831 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.845002 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.845215 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.845529 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.845852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.846183 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.846514 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.846830 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.847161 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.847700 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.847867 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.848094 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.848413 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.848749 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.849088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.849405 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.849720 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.850047 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.850385 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.850778 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.851002 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.851313 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.851622 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.851931 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.852250 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.852564 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.852875 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.853184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.853505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.854683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.854683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.854683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.855334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.855334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.855604 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.855902 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.856229 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.856772 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.857016 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.857223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.858344 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.858344 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.858775 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.859174 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.859546 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.859869 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.860267 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.860483 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.861044 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.861279 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.861515 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.861755 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.862066 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.862449 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.862769 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.863133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.863371 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.863787 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.864076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.864326 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.864718 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.864941 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.865365 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.865618 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.865843 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.866301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.866515 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.867061 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.867399 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.867720 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.868040 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.868595 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.868829 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.869380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.869380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.869820 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.870034 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.870335 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.870948 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.871770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.871770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.871770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.872182 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.872399 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.872725 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.873629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.874174 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.874511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.874822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.875151 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.875459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.875779 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.876090 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.876423 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.876765 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.877046 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.877354 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.877683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.878118 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.878534 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.878885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.879219 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.879565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.879877 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.880188 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.880518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.880828 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.881137 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.881447 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.881762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.882077 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.882412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.882730 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.883044 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.883361 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.883672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.883999 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.884290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.884596 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.885169 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.885480 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.885785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.886092 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.886433 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.886742 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.887046 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.887361 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.887675 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.887990 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.888301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.888640 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.889453 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.889767 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.890079 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.890473 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.890808 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.891122 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.891430 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.891741 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.892047 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.892352 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.892667 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.892992 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.893310 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.893618 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.893929 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.894265 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.894575 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.894879 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.895187 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.895495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.895797 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.896102 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.896406 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.896709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.897034 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.897344 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.897649 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.897956 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.898285 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.898638 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.899014 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.899305 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.899613 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.899984 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.900251 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.900565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.900878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.901196 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.901506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.901824 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.902140 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.902506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.902814 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.903123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.903553 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.903762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.904077 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.904953 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.905262 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.905638 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.905975 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.906233 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.906552 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.906937 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.907167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.907491 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.907799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.908121 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.908434 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.908749 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.909067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.909379 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.909692 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.910003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.910334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.910664 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.910972 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.911282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.911601 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.911908 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.912221 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.912528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.912967 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.913281 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.913713 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.913937 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.914245 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.914627 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.914945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.915263 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.915576 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.916014 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.916326 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.916642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.916955 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.917262 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.917570 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.917882 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.918240 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.918553 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.918861 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.919169 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.919494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.919801 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.920293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.920726 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.921148 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.921459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.921890 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.922274 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.922594 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.922924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.923320 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.923677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.924028 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.924374 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.924692 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.925026 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.925355 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.925672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.925993 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.926332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.926661 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.927013 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.927311 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.927637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.928079 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.928408 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.928720 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.929050 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.929381 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.930515 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.931026 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.931467 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.931916 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.932561 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.933016 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.933418 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.934103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.935167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.935894 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.936651 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.937289 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.937850 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.938462 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.939083 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.939686 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.940290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.940908 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.941492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.942112 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.943028 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.943638 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.944422 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.945058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.945731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.946333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.946961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.947589 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.948200 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.948792 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.949395 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.950142 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.950784 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.951944 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.952828 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.953415 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.954017 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.954654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.955418 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.956010 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.956579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.957155 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.957746 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.958382 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.958971 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.959856 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.961030 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.961640 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.962256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.963013 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.963863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.964461 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.965376 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.966594 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.968003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.968420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.968985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.969647 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.969894 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.970196 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.970542 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.971842 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.971842 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.972190 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.972878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.973226 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.973560 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.973892 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.974254 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.974589 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.974926 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.975513 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.976221 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.976467 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.976816 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.977058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.977368 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.977693 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.978193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.978410 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.978760 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.979084 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.979426 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.979759 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.980097 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.980440 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.980775 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.981098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.981416 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.981739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.982106 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.982498 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.982813 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.983136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.983561 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.983884 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.984205 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.984523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.984845 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.985173 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.985492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.985809 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.986379 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.986531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.986828 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.987170 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.987498 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.987817 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.988139 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.988459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.989024 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.989352 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.989692 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.990022 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.990380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.990707 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.991032 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.991369 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.991683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.991994 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.992312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.992629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.992940 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.993267 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.993605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.994004 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.994403 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.994730 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.995362 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.995717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.996040 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.996532 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.996777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.997120 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.997436 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.997771 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.998246 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.998692 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.999022 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.999347 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:08.999742 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.000063 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.000386 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.000789 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.001107 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.001432 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.001745 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.002131 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.002505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.002821 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.003138 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.003459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.003824 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.004081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.004393 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.004705 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.005026 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.005334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.005650 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.005959 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.006301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.006618 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.006981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 07:47:09.007419 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 07:47:09.007738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 07:47:09.008007 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.008124 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 07:47:09.008337 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.008437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 07:47:09.008683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.008822 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.009008 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.009105 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.009325 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.009424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.009946 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.010320 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.010647 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.010807 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.010982 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.011153 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.011297 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.011446 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.011637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.011786 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.011936 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.012109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.012264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.012433 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.012591 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806191-3-iscsi {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.012834 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.013007 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.013159 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.013358 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.013536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.013690 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.014405 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.014655 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.014962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.015120 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.015314 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.015559 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.015709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.015890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.016040 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.016230 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.016424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.016601 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.016788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.016962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.017118 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.017261 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.017423 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.017565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.017756 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.017912 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.018094 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.018279 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.018425 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.018568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.018727 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.018870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.019012 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.019154 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.019302 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.019454 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.019598 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.019745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.019887 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.020084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806191-3-iscsi {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.020234 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.020412 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.020570 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.020735 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.020918 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.021066 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.021493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.021652 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.021827 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.021976 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.022214 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.022372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.022622 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.022781 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.023062 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.023219 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.023362 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.023512 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.023654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.023798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.023940 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.024163 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.024312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.024576 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.024769 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.024915 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.025057 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.025295 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.025491 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.025645 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.025790 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.025978 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.026136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.026388 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.026550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.026694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.026837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.027082 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.027238 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.027382 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.027660 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.027817 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.027962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.028105 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.028253 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.028403 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.028555 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.028706 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.028852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.029013 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.029157 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.029998 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.030233 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.030399 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.030550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.030550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.030848 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.031011 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.031244 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.031401 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.031608 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.031766 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.031922 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.032072 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.032279 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.032429 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.032613 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.032769 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.032941 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.033226 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.033383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.033525 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.033666 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.033832 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.033988 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.034139 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.034325 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.034477 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.034627 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.034778 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.034962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.035113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.035280 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.035430 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.035591 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.035903 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.036076 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.036220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.036363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.036512 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.036653 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.036803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.036953 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.037133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.037290 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.037442 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.037584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.037759 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.037934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.038086 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.038313 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.038469 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.038613 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.038763 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.038907 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.039055 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.039584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.039762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.039922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.040074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.040074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.040450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.040602 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.040752 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.040903 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.041047 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.041197 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.041341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.041490 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.041641 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.041793 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.041935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.042084 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.042272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.042435 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.042608 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.042763 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.042966 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.043121 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.043414 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.043564 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.043564 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.043903 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.044237 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.044487 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 07:47:09.044636 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.044824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.045674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.046002 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.046357 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.046687 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.047014 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.047341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.047665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.048008 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.048344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.048667 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.048990 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.049311 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.049632 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.049968 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.058041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.058041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.058041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.058041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.058041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.058041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.058041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.058041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.060372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.060372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.060372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.060372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.060372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.060372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.060372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.060372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.062888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.062888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.062888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.062888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.062888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.062888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.062888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.062888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.064689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.064689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.064689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 07:47:09.064689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.064689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.064689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.064689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.064689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.066584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.066584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.066584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.066584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.066584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.066584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.066584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.066584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.068567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.068567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.068567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.068567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.068567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.068567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.068567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.068567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.070568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.070568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.070568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.070568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.070568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.070568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.070568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.070568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.072389 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.072389 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.072389 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.072389 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.072389 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.072389 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.072389 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.072389 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.074272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.074272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.074272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.074272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.074272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.074272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.074272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.074272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.076074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.076074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.076074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.076074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.076074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.076074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.076074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.078215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.078215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.078215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.078215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.079338 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.079338 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.079338 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.080035 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.080035 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.080035 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.080709 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.080709 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.081178 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.081418 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.081695 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.081939 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.082263 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.082619 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.082945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.083288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.083627 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.083961 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.084276 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.084610 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.085086 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.085339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.085597 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.085905 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.086249 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.086571 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.086894 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.087207 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.087527 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.087873 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.088194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.088515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.088976 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.089234 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.089478 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.089808 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.090219 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.090546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.090886 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.091226 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.091552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.092445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.092779 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.093111 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.093524 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.093887 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.094253 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.094583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.094919 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.095225 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.095670 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.095900 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.096281 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.096518 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.096853 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.097214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.097570 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.097902 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.098431 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.098607 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.099438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.099648 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.099908 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.100189 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.100513 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.100850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.101171 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.101537 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.101831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.102199 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.102533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.102868 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.103551 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.103551 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.104245 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.104245 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.104624 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.104849 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.105097 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.105424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.105807 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.106283 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.106643 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.106804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.107023 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.107379 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.108238 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.108844 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.109280 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.109577 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.109905 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.110738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.110738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.111056 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.111206 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.111523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.111851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.112182 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.112509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.112827 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.113165 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.113492 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.113816 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.114238 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.114557 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.114925 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.115253 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.115572 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.116010 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.116452 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.116838 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.117175 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.117505 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.117870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.118257 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.118610 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.118921 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.119592 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.119763 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.121934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.121934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.121934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.121934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.121934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.121934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.124160 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.124160 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.124160 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.124853 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.124853 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.125338 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.125670 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.126017 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.126968 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.126968 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.127457 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.127457 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.127967 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.128221 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.128516 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.128849 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.129186 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.129697 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.129963 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.130256 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.130514 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.130788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.131106 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.132208 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.132208 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.132748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.132748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.133250 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.133250 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.133733 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.133992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.134273 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.134550 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.135117 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.135474 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.135796 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.136152 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.136800 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.137228 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.137228 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.137707 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.137937 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.138310 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.138574 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.138860 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.139163 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.139484 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.139917 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.140214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.140542 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.140870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.141188 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.141509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.142654 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.142654 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.142654 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.143417 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.143417 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.143417 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.144092 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.144092 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.144577 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.144577 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.145035 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.145317 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.145542 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.145810 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.146120 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.146470 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.147076 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.147076 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.147717 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.147717 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.148185 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.148449 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.148705 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.149033 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.149438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.149783 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.150220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.150473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.150763 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.151081 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.151404 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.151720 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.152306 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.153066 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.153066 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.153066 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.153806 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.153806 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.154869 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.154869 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.155316 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.155639 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.155964 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.156333 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.156835 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.157941 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.157941 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.157941 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.159102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.159102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.159102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.159102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.160788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.160788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.160788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.160788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.160788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.163437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.163437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.163437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.163437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.163437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.163437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.165047 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_db.sqlalchemy.engines [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:47:09.165350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.165350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.165350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.165350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.165350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.165350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.165350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.165350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.167546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.167546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.167546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.167546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.167546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.167546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.167546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.169604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.169604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.169604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.169604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.169604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.169604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.169604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.171993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.171993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.171993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.171993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.171993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.173674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.173674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.173674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.173674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.173674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.174437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.174437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.174757 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.175026 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.175302 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.175620 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.175951 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.176287 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.176604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.176922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.177240 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.177601 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.177891 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.178491 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.178675 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.178984 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.179307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.179738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.180065 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.180397 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.180732 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.181100 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.181404 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.181720 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.182051 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.182408 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.190755 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.190755 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.190755 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.190755 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.191458 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.192982 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.192982 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.193687 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.193941 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.196334 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.196851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.197362 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.197800 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.198307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.198851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.199301 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.200188 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.200599 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.201032 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.202137 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.202991 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.203426 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.203921 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.204337 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.204888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.206005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.206005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.206005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.206729 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.207048 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.207555 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.207970 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.208363 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.208995 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.209448 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.209846 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.210281 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.210801 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.211277 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.211684 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.212128 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.212552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.212975 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.213391 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.213814 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.214279 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.214683 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.215095 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.215516 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.215910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.216304 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.216738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.217424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.218058 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.218505 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.219055 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.219448 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.219850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.220245 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.220663 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.221057 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.221473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.221875 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.222329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.222696 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.223091 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.223536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.223945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.224373 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.224792 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.225211 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.225623 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.226026 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.226462 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.226865 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.227266 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.228344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.228344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.228344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.228624 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.229221 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.229628 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.230035 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.230466 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.230877 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.231546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.231967 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.240835 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.241439 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.241969 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.242431 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.242864 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.243311 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.243737 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.244158 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.244581 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.245029 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.245453 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.245811 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.246214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.246592 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.246914 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.247250 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.247591 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.248499 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.248720 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.context [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14de09d5-e436-48df-b23e-2bee56c910cd(cell1) {{(pid=114671) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 07:47:09.248837 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.249145 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.249481 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.249818 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.250184 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.250524 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.250855 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.251194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.251531 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.251862 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.252187 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.252519 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.252848 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.253194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.253547 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.253953 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.254240 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.254568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.254726 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:09.254996 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.255700 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.255858 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.256197 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.256440 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:09.256804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.257052 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.257296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:09.257583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.257583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.258046 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.258321 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.258638 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.258970 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.259352 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.259630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:09.260165 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.260165 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.260753 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.260753 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.261276 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.261491 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.262211 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.262466 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.263227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.263227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.264338 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.264338 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.264834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.264834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.265261 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.265496 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.266117 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.266565 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.266804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.267068 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.267392 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.267716 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.268031 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.268561 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.268760 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.268997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.269317 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.269639 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.269953 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.270312 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.270640 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.270943 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.271267 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.271588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.271915 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.272224 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.272546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.272971 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.273557 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_db.sqlalchemy.engines [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:47:09.273722 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.273722 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.274018 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.274210 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.274432 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.274749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.275067 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.276252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.276598 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.276951 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.277489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.277823 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.278225 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.279088 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.280790 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.280790 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.280790 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.280790 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.286748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.286748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.286748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.286748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.286748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.286748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.286748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.286748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.288741 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.288741 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.288741 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.288741 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.288741 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.290050 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_db.sqlalchemy.engines [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:47:09.293469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.293469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.293469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.293469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.293469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.293469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.293469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.293469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.296730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.296730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.296730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.296730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.296730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.296730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.296730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.296730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.299112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.299112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.299112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.299112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.299112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.299112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.299112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.299112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.300726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.300726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.300726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.300726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.300726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.300726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.300726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.300726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.302841 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.302841 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.302841 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.302841 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.302841 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.302841 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.302841 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.302841 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.304665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.304665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.304665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.304665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.305490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.305490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.306361 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.306361 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.307315 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.307315 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.307706 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.308227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.308658 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.309064 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.309458 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.309986 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.310419 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.311623 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.311974 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.312409 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.312740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.313081 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.313531 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.319522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.319522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.319522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.319522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.319522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.319522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.319522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.319522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.324740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.324740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.324740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 07:47:09.324740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 07:47:09.435075 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_db.sqlalchemy.engines [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:47:09.524870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.context [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14de09d5-e436-48df-b23e-2bee56c910cd(cell1) {{(pid=114670) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 07:47:09.529286 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:09.531691 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:09.532575 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:09.536420 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:09.550251 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_db.sqlalchemy.engines [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:47:09.552701 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_db.sqlalchemy.engines [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:47:09.564406 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_db.sqlalchemy.engines [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:47:09.834041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_db.sqlalchemy.engines [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 07:47:09.924919 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: WARNING keystonemiddleware.auth_token [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 07:47:09.931822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: WARNING keystonemiddleware.auth_token [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 07:47:10.178130 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: WARNING keystonemiddleware.auth_token [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 07:47:10.186181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: WARNING keystonemiddleware.auth_token [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 07:47:10.305767 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: WARNING keystonemiddleware.auth_token [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 07:47:10.313216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: WARNING keystonemiddleware.auth_token [None req-7c47c911-f423-4bfd-9453-47b961118ca0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 07:47:10.318834 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d6a1e4e9c0 pid: 114671 (default app) Aug 30 07:47:10.540309 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: WARNING keystonemiddleware.auth_token [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 07:47:10.546721 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: WARNING keystonemiddleware.auth_token [None req-db6d50a1-1510-43fd-b7a5-be1449a83268 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 07:47:10.552029 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d6a1e4e9c0 pid: 114670 (default app) Aug 30 07:47:46.610943 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d72010f4-6ace-474a-a78d-78c669eb31e4 tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] Action: 'create', calling method: .version_select at 0x7f341e0a31f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1458997200", "metadata": {"Type": "work"}}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:47:47.567892 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d72010f4-6ace-474a-a78d-78c669eb31e4 tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.568502 Aug 30 07:47:47.568599 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 1/1] 10.222.0.73 () {60 vars in 1156 bytes} [Mon Aug 30 07:47:44 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2572 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 07:47:48.089548 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1173615267", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "networks": [{"uuid": "48af5f56-a712-424c-ad52-bbe266bf5358"}]}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:47:48.092673 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-14f84a5b-e3d6-47ae-bbd5-2771c85110f4 tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] Calling method '.version_select at 0x7f341e0d4ee0>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:48.353771 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.network.neutron [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] validate_networks() for [('48af5f56-a712-424c-ad52-bbe266bf5358', None, None, None, None, None)] {{(pid=114671) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:47:48.750459 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-14f84a5b-e3d6-47ae-bbd5-2771c85110f4 tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8b30853d-5c4f-48e3-aadb-5603634c4845" status: 200 len: 354 microversion: 2.1 time: 1.169694 Aug 30 07:47:48.751063 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 1/2] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:47:47 2021] GET /compute/v2.1/os-volumes/8b30853d-5c4f-48e3-aadb-5603634c4845 => generated 354 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:47:48.763723 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-75a5ff5e-1cdc-44ae-9b9e-d25c995015c3 tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] Calling method '.version_select at 0x7f341dfafca0>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:48.888061 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-75a5ff5e-1cdc-44ae-9b9e-d25c995015c3 tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8b30853d-5c4f-48e3-aadb-5603634c4845" status: 200 len: 354 microversion: 2.1 time: 0.127761 Aug 30 07:47:48.888833 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 2/3] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:47:48 2021] GET /compute/v2.1/os-volumes/8b30853d-5c4f-48e3-aadb-5603634c4845 => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:47:48.907584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-54c1ea49-c6b6-4c85-964e-9eb522c8feec tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] Calling method '.version_select at 0x7f341df69550>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:49.186552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-54c1ea49-c6b6-4c85-964e-9eb522c8feec tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/8b30853d-5c4f-48e3-aadb-5603634c4845" status: 202 len: 0 microversion: 2.1 time: 0.282834 Aug 30 07:47:49.188127 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 3/4] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 30 07:47:48 2021] DELETE /compute/v2.1/os-volumes/8b30853d-5c4f-48e3-aadb-5603634c4845 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:47:49.192962 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-51289950-4867-4775-b281-a0e1544390bd tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] Calling method '.version_select at 0x7f341df69c10>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:49.331249 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-51289950-4867-4775-b281-a0e1544390bd tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/e5a74fea-4d8f-4773-b7df-763178027556" status: 200 len: 351 microversion: 2.1 time: 0.141538 Aug 30 07:47:49.332088 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 4/5] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:47:49 2021] GET /compute/v2.1/os-volumes/e5a74fea-4d8f-4773-b7df-763178027556 => generated 351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:47:49.336656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7ffbb793-b3ca-4822-b6f5-697111f99c1b tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] Calling method '.version_select at 0x7f341df69dc0>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:49.545738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7ffbb793-b3ca-4822-b6f5-697111f99c1b tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8b30853d-5c4f-48e3-aadb-5603634c4845" status: 200 len: 353 microversion: 2.1 time: 0.212458 Aug 30 07:47:49.546687 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 5/6] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:47:49 2021] GET /compute/v2.1/os-volumes/8b30853d-5c4f-48e3-aadb-5603634c4845 => generated 353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:47:50.571843 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Flavor limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:47:50.572387 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Image limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:47:50.573577 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Flavor pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:47:50.574065 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Image pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:47:50.574555 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:47:50.611874 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:50.617143 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:50.618072 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:50.621107 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:50.679020 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Getting quotas for project b7540de7f257475e864b4023460d355a. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:47:50.689186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Getting quotas for user 93170b4e61c9470ba9b7ec6bb66e86e0 and project b7540de7f257475e864b4023460d355a. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:47:50.707844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Going to run 1 instances... {{(pid=114671) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:47:50.711787 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:47:50.787518 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-756225821", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "networks": [{"uuid": "69687f73-4af7-4d54-9e37-a68d55f807fe"}]}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:47:50.914098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e3212667-96b4-4bb8-aa56-d682128184d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.988619 Aug 30 07:47:50.921156 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 2/7] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:47:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 2998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:47:50.930317 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-845afbca-74de-4808-8034-63a1ba1af154 tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] Calling method '.version_select at 0x7f341d5fb430>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:50.990873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-845afbca-74de-4808-8034-63a1ba1af154 tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] HTTP exception thrown: Volume 8b30853d-5c4f-48e3-aadb-5603634c4845 could not be found. Aug 30 07:47:50.992057 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-845afbca-74de-4808-8034-63a1ba1af154 tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] Returning 404 to user: Volume 8b30853d-5c4f-48e3-aadb-5603634c4845 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:47:50.993167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-845afbca-74de-4808-8034-63a1ba1af154 tempest-VolumesGetTestJSON-477113911 tempest-VolumesGetTestJSON-477113911-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8b30853d-5c4f-48e3-aadb-5603634c4845" status: 404 len: 109 microversion: 2.1 time: 0.070456 Aug 30 07:47:50.994428 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 3/8] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:47:50 2021] GET /compute/v2.1/os-volumes/8b30853d-5c4f-48e3-aadb-5603634c4845 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:47:51.002989 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6e55b043-7b17-451c-8f39-08325e5c24f6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:51.003910 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6e55b043-7b17-451c-8f39-08325e5c24f6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:47:51.027830 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] validate_networks() for [('69687f73-4af7-4d54-9e37-a68d55f807fe', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:47:51.281521 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6e55b043-7b17-451c-8f39-08325e5c24f6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:47:51.338453 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6e55b043-7b17-451c-8f39-08325e5c24f6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1218 microversion: 2.1 time: 0.342248 Aug 30 07:47:51.341380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 4/9] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:47:50 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1218 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:47:51.458339 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3f50b562-200b-44e5-943c-4600109a2ba9 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] Calling method '.version_select at 0x7f341d5fb670>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:51.605090 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3f50b562-200b-44e5-943c-4600109a2ba9 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/ee227dc1-1dbc-4bf0-9d4e-96328c739589" status: 200 len: 351 microversion: 2.1 time: 0.156469 Aug 30 07:47:51.606328 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 5/10] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:47:51 2021] GET /compute/v2.1/os-volumes/ee227dc1-1dbc-4bf0-9d4e-96328c739589 => generated 351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:47:52.358625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ee2998ce-8bbd-4a99-ae42-f5abd59f20aa tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:52.359625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ee2998ce-8bbd-4a99-ae42-f5abd59f20aa tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:47:52.485781 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ee2998ce-8bbd-4a99-ae42-f5abd59f20aa tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:47:52.496838 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ee2998ce-8bbd-4a99-ae42-f5abd59f20aa tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1218 microversion: 2.1 time: 0.139644 Aug 30 07:47:52.497493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 6/11] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:47:52 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:47:53.262855 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0445b35d-4dbb-4b75-9ce2-c7637294a231 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] Calling method '.version_select at 0x7f341cdc6b80>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:53.361676 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0445b35d-4dbb-4b75-9ce2-c7637294a231 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/2dc16136-1803-42ed-b597-41be98e5ca15" status: 200 len: 350 microversion: 2.1 time: 0.103983 Aug 30 07:47:53.362888 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 7/12] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:47:53 2021] GET /compute/v2.1/os-volumes/2dc16136-1803-42ed-b597-41be98e5ca15 => generated 350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:47:53.386027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-678349b1-62ed-46e5-a04b-5000e60fe131 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] Calling method '.version_select at 0x7f341cdb44c0>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:53.499820 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:47:53.500320 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:47:53.500712 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:47:53.501307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:47:53.502246 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:47:53.531390 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:53.536768 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:53.537901 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:53.539558 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:53.589812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-678349b1-62ed-46e5-a04b-5000e60fe131 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.212350 Aug 30 07:47:53.590678 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 8/13] 10.222.0.73 () {58 vars in 1134 bytes} [Mon Aug 30 07:47:53 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:47:53.595061 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d8bda315-5e64-4830-baf7-94e41d03a014 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:53.595665 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d8bda315-5e64-4830-baf7-94e41d03a014 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:47:53.609488 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d8bda315-5e64-4830-baf7-94e41d03a014 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:53.619303 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d8bda315-5e64-4830-baf7-94e41d03a014 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:53.620422 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d8bda315-5e64-4830-baf7-94e41d03a014 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:53.622180 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d8bda315-5e64-4830-baf7-94e41d03a014 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:53.632650 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Getting quotas for project edf66595a4b84cdd93e7a1eb55bb40f6. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:47:53.651641 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Getting quotas for user d403d89366cb42fabbdd51486035af19 and project edf66595a4b84cdd93e7a1eb55bb40f6. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:47:53.665611 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:47:53.668929 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:47:53.830827 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-545cfe13-5fbe-48fb-b146-e675e1a86456 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.436918 Aug 30 07:47:53.833686 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 6/14] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:47:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 3441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 07:47:53.844166 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a77426c2-e71f-4702-b79e-79d0f5491b4c tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] Calling method '.version_select at 0x7f341d5f3670>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:54.017374 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d8bda315-5e64-4830-baf7-94e41d03a014 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:47:54.020351 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a77426c2-e71f-4702-b79e-79d0f5491b4c tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.185338 Aug 30 07:47:54.020927 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 7/15] 10.222.0.73 () {58 vars in 1149 bytes} [Mon Aug 30 07:47:53 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:47:54.056290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d8bda315-5e64-4830-baf7-94e41d03a014 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1270 microversion: 2.1 time: 0.464509 Aug 30 07:47:54.058810 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 9/16] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:47:53 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1270 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:47:54.078441 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1ce940d8-8357-4b24-bb5b-a8c8ba77706f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:54.082434 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1ce940d8-8357-4b24-bb5b-a8c8ba77706f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:47:54.296258 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1ce940d8-8357-4b24-bb5b-a8c8ba77706f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:47:54.305045 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1ce940d8-8357-4b24-bb5b-a8c8ba77706f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1214 microversion: 2.1 time: 0.243168 Aug 30 07:47:54.316987 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 10/17] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:47:54 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1214 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:47:54.335588 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-576ea5b8-f0e7-4b8c-93d3-56e9f1285a73 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] Calling method '.version_select at 0x7f341cdb4dc0>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:54.462798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ecd75ec5-23f0-4b89-981d-205d632ae085 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'create', calling method: .version_select at 0x7f341d609550>, body: {"keypair": {"name": "tempest-keypair-1050634193"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:47:54.543876 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-576ea5b8-f0e7-4b8c-93d3-56e9f1285a73 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.224483 Aug 30 07:47:54.545154 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 11/18] 10.222.0.73 () {58 vars in 1134 bytes} [Mon Aug 30 07:47:54 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:47:54.561632 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6a41a945-d34c-4a9e-87b5-6bc2f0bd67df tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] Calling method '.version_select at 0x7f341cd02dc0>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:54.577921 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-ecd75ec5-23f0-4b89-981d-205d632ae085 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for project e71ca0134bc64db3b85a744bc5da948c. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:47:54.592481 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-ecd75ec5-23f0-4b89-981d-205d632ae085 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for user c8eae3157f0344a6b8fe600144708a51 and project e71ca0134bc64db3b85a744bc5da948c. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:47:54.731189 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6a41a945-d34c-4a9e-87b5-6bc2f0bd67df tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.176736 Aug 30 07:47:54.731877 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 12/19] 10.222.0.73 () {58 vars in 1167 bytes} [Mon Aug 30 07:47:54 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:47:54.761523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fb364612-8936-4d6c-a4d4-cef050d99a4e tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] Calling method '.version_select at 0x7f341cd025e0>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:55.004718 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fb364612-8936-4d6c-a4d4-cef050d99a4e tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.259176 Aug 30 07:47:55.005594 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 13/20] 10.222.0.73 () {58 vars in 1170 bytes} [Mon Aug 30 07:47:54 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:47:55.021314 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5fb92d96-2477-48be-83b7-e82f1ddb76a3 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] Calling method '.version_select at 0x7f341ccf0550>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:55.291817 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5fb92d96-2477-48be-83b7-e82f1ddb76a3 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.275004 Aug 30 07:47:55.300315 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 14/21] 10.222.0.73 () {58 vars in 1155 bytes} [Mon Aug 30 07:47:55 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:47:55.305386 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8662adf8-310f-4102-a1a4-95aef7f22a3e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:55.306014 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8662adf8-310f-4102-a1a4-95aef7f22a3e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:47:55.323542 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8662adf8-310f-4102-a1a4-95aef7f22a3e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:55.327798 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8662adf8-310f-4102-a1a4-95aef7f22a3e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:55.328872 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8662adf8-310f-4102-a1a4-95aef7f22a3e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:55.332916 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8662adf8-310f-4102-a1a4-95aef7f22a3e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:55.821263 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-ecd75ec5-23f0-4b89-981d-205d632ae085 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for project e71ca0134bc64db3b85a744bc5da948c. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:47:55.833515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-ecd75ec5-23f0-4b89-981d-205d632ae085 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for user c8eae3157f0344a6b8fe600144708a51 and project e71ca0134bc64db3b85a744bc5da948c. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:47:55.867172 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ecd75ec5-23f0-4b89-981d-205d632ae085 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.842713 Aug 30 07:47:55.870826 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 8/22] 10.222.0.73 () {60 vars in 1158 bytes} [Mon Aug 30 07:47:54 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:47:55.884500 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-980dc49e-fbd2-4f31-990f-457e60ad2120 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] Calling method '.version_select at 0x7f341d60f160>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:56.121332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8662adf8-310f-4102-a1a4-95aef7f22a3e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:47:56.137732 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8662adf8-310f-4102-a1a4-95aef7f22a3e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1276 microversion: 2.1 time: 0.836178 Aug 30 07:47:56.161955 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 15/23] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:47:55 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1276 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:47:56.172995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d442de12-b59d-4ea8-a321-cd72e913a5a2 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:56.182608 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d442de12-b59d-4ea8-a321-cd72e913a5a2 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:47:56.208159 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d442de12-b59d-4ea8-a321-cd72e913a5a2 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:56.210954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d442de12-b59d-4ea8-a321-cd72e913a5a2 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:56.213295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d442de12-b59d-4ea8-a321-cd72e913a5a2 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:56.216579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d442de12-b59d-4ea8-a321-cd72e913a5a2 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:56.266005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-980dc49e-fbd2-4f31-990f-457e60ad2120 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.393147 Aug 30 07:47:56.275424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 9/24] 10.222.0.73 () {58 vars in 1188 bytes} [Mon Aug 30 07:47:55 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:47:56.282910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6c00bda3-992f-49c4-a537-d28205338fb0 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] Calling method '.version_select at 0x7f341c5c9c10>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:56.617962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d442de12-b59d-4ea8-a321-cd72e913a5a2 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:47:56.617962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d442de12-b59d-4ea8-a321-cd72e913a5a2 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1266 microversion: 2.1 time: 0.308906 Aug 30 07:47:56.617962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 16/25] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:47:56 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:47:56.713085 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6c00bda3-992f-49c4-a537-d28205338fb0 tempest-VolumesTestJSON-715882664 tempest-VolumesTestJSON-715882664-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.435612 Aug 30 07:47:56.713665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 10/26] 10.222.0.73 () {58 vars in 1155 bytes} [Mon Aug 30 07:47:56 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:47:57.181687 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2cced388-c7d6-46bb-b5f3-bcea3acadd12 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:57.196780 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2cced388-c7d6-46bb-b5f3-bcea3acadd12 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:47:57.199797 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2cced388-c7d6-46bb-b5f3-bcea3acadd12 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:57.201098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2cced388-c7d6-46bb-b5f3-bcea3acadd12 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:57.204241 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2cced388-c7d6-46bb-b5f3-bcea3acadd12 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:57.205038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2cced388-c7d6-46bb-b5f3-bcea3acadd12 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:57.497822 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ef2a2488-e2a8-40bb-894d-44a69060c416 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:57.499174 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ef2a2488-e2a8-40bb-894d-44a69060c416 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:47:57.538530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef2a2488-e2a8-40bb-894d-44a69060c416 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:57.539926 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef2a2488-e2a8-40bb-894d-44a69060c416 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:57.541370 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef2a2488-e2a8-40bb-894d-44a69060c416 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:57.543675 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef2a2488-e2a8-40bb-894d-44a69060c416 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:57.862030 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2cced388-c7d6-46bb-b5f3-bcea3acadd12 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:47:57.885009 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2cced388-c7d6-46bb-b5f3-bcea3acadd12 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1276 microversion: 2.1 time: 0.709532 Aug 30 07:47:57.901495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 17/27] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:47:57 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1276 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:47:58.728850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ef2a2488-e2a8-40bb-894d-44a69060c416 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:47:58.786946 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ef2a2488-e2a8-40bb-894d-44a69060c416 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1272 microversion: 2.1 time: 1.293654 Aug 30 07:47:58.791025 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 11/28] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:47:57 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1272 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:47:58.910914 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-013f0aa6-7c0d-4f8a-97b7-2582886eecda tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:58.911793 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-013f0aa6-7c0d-4f8a-97b7-2582886eecda tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:47:58.930573 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-013f0aa6-7c0d-4f8a-97b7-2582886eecda tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:58.931359 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-013f0aa6-7c0d-4f8a-97b7-2582886eecda tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:58.933332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-013f0aa6-7c0d-4f8a-97b7-2582886eecda tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:58.934026 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-013f0aa6-7c0d-4f8a-97b7-2582886eecda tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:59.809286 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f35b1869-670f-47dd-9bf4-1b8e5dd4ca89 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:47:59.810098 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f35b1869-670f-47dd-9bf4-1b8e5dd4ca89 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:47:59.822365 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f35b1869-670f-47dd-9bf4-1b8e5dd4ca89 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:59.824904 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f35b1869-670f-47dd-9bf4-1b8e5dd4ca89 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:47:59.825851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f35b1869-670f-47dd-9bf4-1b8e5dd4ca89 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:47:59.826329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f35b1869-670f-47dd-9bf4-1b8e5dd4ca89 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:00.163034 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f35b1869-670f-47dd-9bf4-1b8e5dd4ca89 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:00.185829 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f35b1869-670f-47dd-9bf4-1b8e5dd4ca89 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1272 microversion: 2.1 time: 0.381411 Aug 30 07:48:00.187876 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 12/29] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:47:59 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1272 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:00.713134 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-013f0aa6-7c0d-4f8a-97b7-2582886eecda tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:00.728762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-013f0aa6-7c0d-4f8a-97b7-2582886eecda tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 1.818317 Aug 30 07:48:00.729238 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 18/30] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:47:58 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:01.205627 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5b8e8e53-447d-43ea-90e2-a145df03a276 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:01.207595 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5b8e8e53-447d-43ea-90e2-a145df03a276 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:01.216220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b8e8e53-447d-43ea-90e2-a145df03a276 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:01.232921 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b8e8e53-447d-43ea-90e2-a145df03a276 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:01.234764 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b8e8e53-447d-43ea-90e2-a145df03a276 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:01.235428 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b8e8e53-447d-43ea-90e2-a145df03a276 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:01.635506 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5b8e8e53-447d-43ea-90e2-a145df03a276 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:01.651066 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5b8e8e53-447d-43ea-90e2-a145df03a276 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1272 microversion: 2.1 time: 0.450129 Aug 30 07:48:01.656724 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 13/31] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:01 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1272 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:01.749145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d9758f9e-60bb-4122-ad19-a51f659d8927 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:01.750867 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d9758f9e-60bb-4122-ad19-a51f659d8927 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:01.772179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9758f9e-60bb-4122-ad19-a51f659d8927 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:01.773567 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9758f9e-60bb-4122-ad19-a51f659d8927 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:01.777766 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9758f9e-60bb-4122-ad19-a51f659d8927 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:01.779842 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9758f9e-60bb-4122-ad19-a51f659d8927 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:02.672730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-dd4e9896-3daa-473e-b177-c60810b0e3f7 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:02.674275 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-dd4e9896-3daa-473e-b177-c60810b0e3f7 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:02.688564 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd4e9896-3daa-473e-b177-c60810b0e3f7 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:02.694049 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd4e9896-3daa-473e-b177-c60810b0e3f7 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:02.695068 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd4e9896-3daa-473e-b177-c60810b0e3f7 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:02.695641 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd4e9896-3daa-473e-b177-c60810b0e3f7 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:02.770501 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d9758f9e-60bb-4122-ad19-a51f659d8927 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:02.784081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d9758f9e-60bb-4122-ad19-a51f659d8927 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 1.042880 Aug 30 07:48:02.794244 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 19/32] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:01 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:02.915134 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-dd4e9896-3daa-473e-b177-c60810b0e3f7 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:02.927034 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-dd4e9896-3daa-473e-b177-c60810b0e3f7 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1272 microversion: 2.1 time: 0.257838 Aug 30 07:48:02.931289 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 14/33] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:02 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:03.802528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1f766a84-fbb0-4841-9e58-6e19a8dee66c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:03.804084 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1f766a84-fbb0-4841-9e58-6e19a8dee66c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:03.825401 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1f766a84-fbb0-4841-9e58-6e19a8dee66c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:03.828436 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1f766a84-fbb0-4841-9e58-6e19a8dee66c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:03.834742 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1f766a84-fbb0-4841-9e58-6e19a8dee66c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:03.840539 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1f766a84-fbb0-4841-9e58-6e19a8dee66c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:03.949217 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-470764cd-8493-4520-942a-7e24bcc175ac tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:03.951267 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-470764cd-8493-4520-942a-7e24bcc175ac tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:03.969331 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-470764cd-8493-4520-942a-7e24bcc175ac tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:03.970094 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-470764cd-8493-4520-942a-7e24bcc175ac tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:03.971879 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-470764cd-8493-4520-942a-7e24bcc175ac tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:03.975837 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-470764cd-8493-4520-942a-7e24bcc175ac tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:04.358293 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-470764cd-8493-4520-942a-7e24bcc175ac tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:04.388224 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-470764cd-8493-4520-942a-7e24bcc175ac tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.444075 Aug 30 07:48:04.388833 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 15/34] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:03 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:04.675224 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1f766a84-fbb0-4841-9e58-6e19a8dee66c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:04.686567 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1f766a84-fbb0-4841-9e58-6e19a8dee66c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.888385 Aug 30 07:48:04.687459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 20/35] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:03 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:05.432137 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1277754498", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83b43835-9098-4d89-a14a-34cf351e7cdb"}]}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:05.508237 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] validate_networks() for [('83b43835-9098-4d89-a14a-34cf351e7cdb', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:48:05.597510 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-9b54fbaf-de35-4a2a-be48-04cd8f15658e req-c29aba2c-7b96-45b7-a110-99b73a9d2523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4967d79f-d77e-494e-913b-b11b09a5dee4", "tag": "6775eff3-812a-4ed1-8de8-36fd5d098c28"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:05.599852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:48:05.599852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:48:05.617858 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-9b54fbaf-de35-4a2a-be48-04cd8f15658e req-c29aba2c-7b96-45b7-a110-99b73a9d2523 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:05.618761 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-9b54fbaf-de35-4a2a-be48-04cd8f15658e req-c29aba2c-7b96-45b7-a110-99b73a9d2523 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:05.644010 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-9b54fbaf-de35-4a2a-be48-04cd8f15658e req-c29aba2c-7b96-45b7-a110-99b73a9d2523 service nova] Creating event network-changed:6775eff3-812a-4ed1-8de8-36fd5d098c28 for instance 4967d79f-d77e-494e-913b-b11b09a5dee4 on hv-cinder-80619 Aug 30 07:48:05.644747 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-9b54fbaf-de35-4a2a-be48-04cd8f15658e req-c29aba2c-7b96-45b7-a110-99b73a9d2523 service nova] Acquired lock "compute-rpcapi-router" {{(pid=114671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 30 07:48:05.646329 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-326c1330-61f1-45d9-8249-8935f6793041 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:05.646845 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-326c1330-61f1-45d9-8249-8935f6793041 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:05.647838 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-326c1330-61f1-45d9-8249-8935f6793041 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:05.648456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-326c1330-61f1-45d9-8249-8935f6793041 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:05.658291 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.compute.rpcapi [None req-326c1330-61f1-45d9-8249-8935f6793041 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 30 07:48:05.659500 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-326c1330-61f1-45d9-8249-8935f6793041 None None] Releasing lock "compute-rpcapi-router" {{(pid=114671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 30 07:48:05.687211 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-326c1330-61f1-45d9-8249-8935f6793041 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347986 Aug 30 07:48:05.687928 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 21/36] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:48:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:48:05.696600 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b476e005-3a12-43b7-800f-851d7befa12b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:05.697352 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b476e005-3a12-43b7-800f-851d7befa12b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:05.705482 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b476e005-3a12-43b7-800f-851d7befa12b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:05.706458 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b476e005-3a12-43b7-800f-851d7befa12b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:05.707725 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b476e005-3a12-43b7-800f-851d7befa12b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:05.708350 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b476e005-3a12-43b7-800f-851d7befa12b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:05.954777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b476e005-3a12-43b7-800f-851d7befa12b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:05.976945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b476e005-3a12-43b7-800f-851d7befa12b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.287174 Aug 30 07:48:05.986954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 22/37] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:05 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:06.008738 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-986727628", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0b6d139-5ec8-4ecd-be42-a32d8b014bf5"}], "security_groups": [{"name": "tempest-securitygroup--530159310"}], "key_name": "tempest-keypair-1050634193", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:06.165640 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.network.neutron [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] validate_networks() for [('c0b6d139-5ec8-4ecd-be42-a32d8b014bf5', None, None, None, None, None)] {{(pid=114671) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:48:06.184226 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:48:06.184945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:48:06.185582 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:48:06.186169 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:48:06.186735 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:48:06.197324 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:06.198851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:06.200100 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:06.201514 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:06.227912 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Getting quotas for project a5f4656c08fc44eb93611972f4bebb0e. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:48:06.241609 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Getting quotas for user 8d71c0e1066f4c2aa935171a74051b52 and project a5f4656c08fc44eb93611972f4bebb0e. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:48:06.263874 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:48:06.271050 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:48:06.384911 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7df35db1-43e0-41a8-9e40-a92085ab29d4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.298630 Aug 30 07:48:06.393975 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 16/38] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:48:05 2021] POST /compute/v2.1/servers => generated 383 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:48:06.399059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-16e1c4a0-19d7-40ee-8f4d-af0bd540095c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:06.405627 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-16e1c4a0-19d7-40ee-8f4d-af0bd540095c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:06.424540 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-16e1c4a0-19d7-40ee-8f4d-af0bd540095c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:06.425296 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-16e1c4a0-19d7-40ee-8f4d-af0bd540095c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:06.426331 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-16e1c4a0-19d7-40ee-8f4d-af0bd540095c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:06.426995 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-16e1c4a0-19d7-40ee-8f4d-af0bd540095c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:06.731239 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-16e1c4a0-19d7-40ee-8f4d-af0bd540095c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:06.758328 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-16e1c4a0-19d7-40ee-8f4d-af0bd540095c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.361721 Aug 30 07:48:06.758936 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 17/39] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:06 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:06.774508 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-eb8a260a-14c1-4694-b4cd-9132819d0f78 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:06.777146 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-eb8a260a-14c1-4694-b4cd-9132819d0f78 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:06.955676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-eb8a260a-14c1-4694-b4cd-9132819d0f78 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:06.976595 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-eb8a260a-14c1-4694-b4cd-9132819d0f78 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1222 microversion: 2.1 time: 0.214283 Aug 30 07:48:06.977941 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 18/40] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:06 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1222 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:06.997073 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-644f4405-2342-4d07-96a3-1eb8afd06f50 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:06.999600 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-644f4405-2342-4d07-96a3-1eb8afd06f50 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:07.016868 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-644f4405-2342-4d07-96a3-1eb8afd06f50 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:07.020469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-644f4405-2342-4d07-96a3-1eb8afd06f50 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:07.022639 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-644f4405-2342-4d07-96a3-1eb8afd06f50 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:07.024041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-644f4405-2342-4d07-96a3-1eb8afd06f50 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:07.291735 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Flavor limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:48:07.293411 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Image limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:48:07.294494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Flavor pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:48:07.295427 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Image pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:48:07.296076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:48:07.364750 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:07.365214 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:07.381094 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-644f4405-2342-4d07-96a3-1eb8afd06f50 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:07.404731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:07.406910 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:07.443270 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-644f4405-2342-4d07-96a3-1eb8afd06f50 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.449901 Aug 30 07:48:07.460077 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 19/41] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:06 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:07.463261 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for project e71ca0134bc64db3b85a744bc5da948c. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:48:07.470497 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for user c8eae3157f0344a6b8fe600144708a51 and project e71ca0134bc64db3b85a744bc5da948c. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:48:07.521933 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-364772030", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83b43835-9098-4d89-a14a-34cf351e7cdb"}]}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:07.541380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Going to run 1 instances... {{(pid=114671) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:48:07.548484 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:48:07.653732 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] validate_networks() for [('83b43835-9098-4d89-a14a-34cf351e7cdb', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:48:07.673087 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-67b67d35-145e-47ec-90f1-2885a09fc1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.681852 Aug 30 07:48:07.678687 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 23/42] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:48:05 2021] POST /compute/v2.1/servers => generated 401 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:48:07.687417 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-44f7c95c-ec42-4304-a715-4c9d7193e11e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:07.688067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-44f7c95c-ec42-4304-a715-4c9d7193e11e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:08.327928 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-44f7c95c-ec42-4304-a715-4c9d7193e11e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:08.342951 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-44f7c95c-ec42-4304-a715-4c9d7193e11e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1237 microversion: 2.1 time: 0.662839 Aug 30 07:48:08.343587 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 24/43] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:07 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1237 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:08.390166 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3cb62222-769b-46a3-bc41-6fe7fd99aaae tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:08.390166 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3cb62222-769b-46a3-bc41-6fe7fd99aaae tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:08.422561 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3cb62222-769b-46a3-bc41-6fe7fd99aaae tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:08.423006 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3cb62222-769b-46a3-bc41-6fe7fd99aaae tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:08.432119 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3cb62222-769b-46a3-bc41-6fe7fd99aaae tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:08.432119 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3cb62222-769b-46a3-bc41-6fe7fd99aaae tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:08.540923 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:48:08.541448 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:48:08.542195 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:48:08.542678 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:48:08.543113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:48:08.563904 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:08.566750 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:08.568455 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:08.569144 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:08.629274 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Getting quotas for project a5f4656c08fc44eb93611972f4bebb0e. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:48:08.641722 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Getting quotas for user 8d71c0e1066f4c2aa935171a74051b52 and project a5f4656c08fc44eb93611972f4bebb0e. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:48:08.662656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:48:08.668910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:48:08.731922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0c822dd2-00ba-4f7e-ade8-128b62410c4b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.217170 Aug 30 07:48:08.733836 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 20/44] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:48:07 2021] POST /compute/v2.1/servers => generated 383 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 07:48:08.740371 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-46467400-bdaa-49b7-ad3e-62d047c03325 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:08.741274 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-46467400-bdaa-49b7-ad3e-62d047c03325 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:08.747829 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46467400-bdaa-49b7-ad3e-62d047c03325 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:08.748836 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46467400-bdaa-49b7-ad3e-62d047c03325 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:08.749846 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46467400-bdaa-49b7-ad3e-62d047c03325 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:08.750471 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46467400-bdaa-49b7-ad3e-62d047c03325 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:08.933268 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3cb62222-769b-46a3-bc41-6fe7fd99aaae tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:08.954131 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3cb62222-769b-46a3-bc41-6fe7fd99aaae tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.609491 Aug 30 07:48:08.964852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 25/45] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:08 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:08.964852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-528c117e-69e9-48c5-87a2-5635091fb533 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:08.971264 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-528c117e-69e9-48c5-87a2-5635091fb533 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:09.050774 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-528c117e-69e9-48c5-87a2-5635091fb533 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:09.061802 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-528c117e-69e9-48c5-87a2-5635091fb533 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1221 microversion: 2.1 time: 0.102539 Aug 30 07:48:09.071963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 26/46] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:08 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:09.085123 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-46467400-bdaa-49b7-ad3e-62d047c03325 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:09.098527 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-46467400-bdaa-49b7-ad3e-62d047c03325 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.362959 Aug 30 07:48:09.100579 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 21/47] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:08 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:09.361865 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9d42ed0e-f628-4a09-9f7e-9a1110012d94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:09.362659 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9d42ed0e-f628-4a09-9f7e-9a1110012d94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:09.370295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d42ed0e-f628-4a09-9f7e-9a1110012d94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:09.371077 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d42ed0e-f628-4a09-9f7e-9a1110012d94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:09.372137 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d42ed0e-f628-4a09-9f7e-9a1110012d94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:09.375746 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d42ed0e-f628-4a09-9f7e-9a1110012d94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:09.519706 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9d42ed0e-f628-4a09-9f7e-9a1110012d94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:09.559713 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9d42ed0e-f628-4a09-9f7e-9a1110012d94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1241 microversion: 2.1 time: 0.199347 Aug 30 07:48:09.561012 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 27/48] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:09 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1241 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:09.671017 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-b5f16a4c-d8b7-4f3b-9d28-2e10141512f0 req-beaa3807-41be-4305-b4ab-249256ede042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7e7530-d91c-4112-98e3-e0297020dfb6", "tag": "708e585c-b3c8-47c5-afdf-a68c26eb49ca"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:09.676057 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:48:09.676057 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:48:09.690804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-b5f16a4c-d8b7-4f3b-9d28-2e10141512f0 req-beaa3807-41be-4305-b4ab-249256ede042 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:09.691532 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-b5f16a4c-d8b7-4f3b-9d28-2e10141512f0 req-beaa3807-41be-4305-b4ab-249256ede042 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:09.744630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-b5f16a4c-d8b7-4f3b-9d28-2e10141512f0 req-beaa3807-41be-4305-b4ab-249256ede042 service nova] Creating event network-changed:708e585c-b3c8-47c5-afdf-a68c26eb49ca for instance bf7e7530-d91c-4112-98e3-e0297020dfb6 on hv-cinder-80619 Aug 30 07:48:09.746559 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-b5f16a4c-d8b7-4f3b-9d28-2e10141512f0 req-beaa3807-41be-4305-b4ab-249256ede042 service nova] Acquired lock "compute-rpcapi-router" {{(pid=114670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 30 07:48:09.750548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-743a49fb-9799-4f29-9b68-3105b9307208 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:09.751010 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-743a49fb-9799-4f29-9b68-3105b9307208 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:09.753141 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-743a49fb-9799-4f29-9b68-3105b9307208 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:09.756441 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-743a49fb-9799-4f29-9b68-3105b9307208 None None] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:09.780221 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.compute.rpcapi [None req-743a49fb-9799-4f29-9b68-3105b9307208 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 30 07:48:09.781142 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-743a49fb-9799-4f29-9b68-3105b9307208 None None] Releasing lock "compute-rpcapi-router" {{(pid=114670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 30 07:48:09.823142 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-743a49fb-9799-4f29-9b68-3105b9307208 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163011 Aug 30 07:48:09.825778 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 22/49] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:48:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:48:09.971403 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dcf16cbd-6c1f-49ed-be76-ac39c10d9b96 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:09.971982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dcf16cbd-6c1f-49ed-be76-ac39c10d9b96 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:09.979207 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dcf16cbd-6c1f-49ed-be76-ac39c10d9b96 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:09.980188 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dcf16cbd-6c1f-49ed-be76-ac39c10d9b96 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:09.987485 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dcf16cbd-6c1f-49ed-be76-ac39c10d9b96 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:09.990202 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dcf16cbd-6c1f-49ed-be76-ac39c10d9b96 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:10.082860 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-80092d7f-3580-4e31-8414-67a5765a4cfd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:10.083695 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-80092d7f-3580-4e31-8414-67a5765a4cfd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:10.107870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-80092d7f-3580-4e31-8414-67a5765a4cfd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:10.108832 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-80092d7f-3580-4e31-8414-67a5765a4cfd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:10.115475 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-80092d7f-3580-4e31-8414-67a5765a4cfd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:10.122860 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-80092d7f-3580-4e31-8414-67a5765a4cfd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:10.295309 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-80092d7f-3580-4e31-8414-67a5765a4cfd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:10.320627 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-80092d7f-3580-4e31-8414-67a5765a4cfd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1225 microversion: 2.1 time: 0.243394 Aug 30 07:48:10.322977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 23/50] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:10 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1225 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:10.334687 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3031fe26-a0ca-4220-8e47-b614941bb1e3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:10.337417 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3031fe26-a0ca-4220-8e47-b614941bb1e3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:10.352423 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3031fe26-a0ca-4220-8e47-b614941bb1e3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:10.352895 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3031fe26-a0ca-4220-8e47-b614941bb1e3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:10.354264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3031fe26-a0ca-4220-8e47-b614941bb1e3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:10.354264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3031fe26-a0ca-4220-8e47-b614941bb1e3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:10.623914 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3031fe26-a0ca-4220-8e47-b614941bb1e3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:10.635587 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3031fe26-a0ca-4220-8e47-b614941bb1e3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.311199 Aug 30 07:48:10.638698 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-dcf16cbd-6c1f-49ed-be76-ac39c10d9b96 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:10.640798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 24/51] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:10 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:10.648961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dcf16cbd-6c1f-49ed-be76-ac39c10d9b96 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.681599 Aug 30 07:48:10.653027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 28/52] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:09 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:10.654500 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-155de1f7-e214-4240-89cf-e6bcad90e116 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:10.658963 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-155de1f7-e214-4240-89cf-e6bcad90e116 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:10.677037 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-155de1f7-e214-4240-89cf-e6bcad90e116 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:10.678709 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-155de1f7-e214-4240-89cf-e6bcad90e116 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:10.683445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-155de1f7-e214-4240-89cf-e6bcad90e116 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:10.684121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-155de1f7-e214-4240-89cf-e6bcad90e116 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:10.800833 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-155de1f7-e214-4240-89cf-e6bcad90e116 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:10.811128 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-155de1f7-e214-4240-89cf-e6bcad90e116 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1241 microversion: 2.1 time: 0.168447 Aug 30 07:48:10.823751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 25/53] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:10 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:11.345249 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-82e039fb-145f-4f40-84b8-841a2f053c0e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:11.346696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-82e039fb-145f-4f40-84b8-841a2f053c0e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:11.360235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-82e039fb-145f-4f40-84b8-841a2f053c0e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:11.361785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-82e039fb-145f-4f40-84b8-841a2f053c0e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:11.363560 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-82e039fb-145f-4f40-84b8-841a2f053c0e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:11.364694 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-82e039fb-145f-4f40-84b8-841a2f053c0e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:11.462499 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-82e039fb-145f-4f40-84b8-841a2f053c0e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:11.471605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-82e039fb-145f-4f40-84b8-841a2f053c0e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1225 microversion: 2.1 time: 0.136754 Aug 30 07:48:11.472571 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 29/54] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:11 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:11.658637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9ebbc029-346a-4708-9cfa-70b945bc4993 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:11.659272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9ebbc029-346a-4708-9cfa-70b945bc4993 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:11.668042 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9ebbc029-346a-4708-9cfa-70b945bc4993 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:11.668450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9ebbc029-346a-4708-9cfa-70b945bc4993 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:11.669275 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9ebbc029-346a-4708-9cfa-70b945bc4993 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:11.669726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9ebbc029-346a-4708-9cfa-70b945bc4993 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:11.670769 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1710ddca-91cf-4b54-86b0-c5c5fb70c39e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:11.672278 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1710ddca-91cf-4b54-86b0-c5c5fb70c39e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:11.688027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1710ddca-91cf-4b54-86b0-c5c5fb70c39e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:11.689022 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1710ddca-91cf-4b54-86b0-c5c5fb70c39e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:11.690282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1710ddca-91cf-4b54-86b0-c5c5fb70c39e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:11.691074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1710ddca-91cf-4b54-86b0-c5c5fb70c39e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:11.855603 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9ebbc029-346a-4708-9cfa-70b945bc4993 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:11.865586 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9ebbc029-346a-4708-9cfa-70b945bc4993 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.209436 Aug 30 07:48:11.877976 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 26/55] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:11 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:11.884258 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-775fe612-e841-4fe0-8f0e-c096d8b3b2b3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:11.888071 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-775fe612-e841-4fe0-8f0e-c096d8b3b2b3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:11.898833 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-775fe612-e841-4fe0-8f0e-c096d8b3b2b3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:11.899351 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-775fe612-e841-4fe0-8f0e-c096d8b3b2b3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:11.901955 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-775fe612-e841-4fe0-8f0e-c096d8b3b2b3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:11.903355 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-775fe612-e841-4fe0-8f0e-c096d8b3b2b3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:11.987528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1710ddca-91cf-4b54-86b0-c5c5fb70c39e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:12.000410 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1710ddca-91cf-4b54-86b0-c5c5fb70c39e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.337360 Aug 30 07:48:12.001143 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 30/56] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:11 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:12.018935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-775fe612-e841-4fe0-8f0e-c096d8b3b2b3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:12.030137 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-775fe612-e841-4fe0-8f0e-c096d8b3b2b3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1241 microversion: 2.1 time: 0.150509 Aug 30 07:48:12.030758 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 27/57] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:11 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:12.492089 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4aacf77b-f092-4669-953b-2b1b8524376d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:12.492717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4aacf77b-f092-4669-953b-2b1b8524376d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:12.502562 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4aacf77b-f092-4669-953b-2b1b8524376d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:12.503087 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4aacf77b-f092-4669-953b-2b1b8524376d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:12.503806 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4aacf77b-f092-4669-953b-2b1b8524376d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:12.504257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4aacf77b-f092-4669-953b-2b1b8524376d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:12.585192 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4aacf77b-f092-4669-953b-2b1b8524376d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:12.594696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4aacf77b-f092-4669-953b-2b1b8524376d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1225 microversion: 2.1 time: 0.107210 Aug 30 07:48:12.595740 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 31/58] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:12 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:12.884622 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5bafeb53-f201-47a3-8bb9-6c6b5b796db1 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:12.885237 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5bafeb53-f201-47a3-8bb9-6c6b5b796db1 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:12.891612 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5bafeb53-f201-47a3-8bb9-6c6b5b796db1 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:12.892384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5bafeb53-f201-47a3-8bb9-6c6b5b796db1 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:12.893202 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5bafeb53-f201-47a3-8bb9-6c6b5b796db1 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:12.893794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5bafeb53-f201-47a3-8bb9-6c6b5b796db1 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:13.018092 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c25893ac-ae96-4a07-b7d2-f9050a5d89d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:13.019456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c25893ac-ae96-4a07-b7d2-f9050a5d89d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:13.045790 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c25893ac-ae96-4a07-b7d2-f9050a5d89d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:13.046179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c25893ac-ae96-4a07-b7d2-f9050a5d89d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:13.049244 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c25893ac-ae96-4a07-b7d2-f9050a5d89d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:13.049736 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c25893ac-ae96-4a07-b7d2-f9050a5d89d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:13.138877 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5bafeb53-f201-47a3-8bb9-6c6b5b796db1 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:13.148233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5bafeb53-f201-47a3-8bb9-6c6b5b796db1 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.267879 Aug 30 07:48:13.149092 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 28/59] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:12 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:13.157811 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b35898c5-84d7-4790-b553-c6d83eceed55 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:13.159736 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b35898c5-84d7-4790-b553-c6d83eceed55 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:13.171806 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b35898c5-84d7-4790-b553-c6d83eceed55 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:13.172881 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b35898c5-84d7-4790-b553-c6d83eceed55 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:13.176281 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b35898c5-84d7-4790-b553-c6d83eceed55 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:13.177342 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b35898c5-84d7-4790-b553-c6d83eceed55 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:13.235975 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c25893ac-ae96-4a07-b7d2-f9050a5d89d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:13.254638 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c25893ac-ae96-4a07-b7d2-f9050a5d89d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.240437 Aug 30 07:48:13.266266 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 32/60] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:13 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:13.282776 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b35898c5-84d7-4790-b553-c6d83eceed55 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:13.299482 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b35898c5-84d7-4790-b553-c6d83eceed55 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1241 microversion: 2.1 time: 0.148993 Aug 30 07:48:13.300986 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 29/61] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:13 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:13.613365 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-90fec836-d775-49e7-846a-0c44901edaa6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:13.614237 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-90fec836-d775-49e7-846a-0c44901edaa6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:13.621284 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-90fec836-d775-49e7-846a-0c44901edaa6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:13.622034 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-90fec836-d775-49e7-846a-0c44901edaa6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:13.623352 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-90fec836-d775-49e7-846a-0c44901edaa6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:13.623925 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-90fec836-d775-49e7-846a-0c44901edaa6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:13.692587 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-90fec836-d775-49e7-846a-0c44901edaa6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:13.700885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-90fec836-d775-49e7-846a-0c44901edaa6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1225 microversion: 2.1 time: 0.091741 Aug 30 07:48:13.701468 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 33/62] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:13 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:14.166551 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-511b02f1-8d33-4a73-84cc-d385addf3161 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:14.168107 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-511b02f1-8d33-4a73-84cc-d385addf3161 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:14.174356 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-511b02f1-8d33-4a73-84cc-d385addf3161 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:14.174987 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-511b02f1-8d33-4a73-84cc-d385addf3161 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:14.175772 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-511b02f1-8d33-4a73-84cc-d385addf3161 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:14.176219 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-511b02f1-8d33-4a73-84cc-d385addf3161 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:14.274566 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-22234369-fb01-46cc-942c-c9a4a17a02d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:14.275282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-22234369-fb01-46cc-942c-c9a4a17a02d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:14.282266 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-22234369-fb01-46cc-942c-c9a4a17a02d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:14.282831 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-22234369-fb01-46cc-942c-c9a4a17a02d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:14.283717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-22234369-fb01-46cc-942c-c9a4a17a02d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:14.284217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-22234369-fb01-46cc-942c-c9a4a17a02d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:14.441593 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-22234369-fb01-46cc-942c-c9a4a17a02d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:14.442092 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-511b02f1-8d33-4a73-84cc-d385addf3161 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:14.449729 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-22234369-fb01-46cc-942c-c9a4a17a02d0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.179303 Aug 30 07:48:14.450122 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-511b02f1-8d33-4a73-84cc-d385addf3161 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.287694 Aug 30 07:48:14.450459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 34/63] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:14 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:14.455286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2065e4da-0138-48a6-a4a3-11a9827087cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:14.455476 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 30/64] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:14 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:14.456312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2065e4da-0138-48a6-a4a3-11a9827087cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:14.466510 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2065e4da-0138-48a6-a4a3-11a9827087cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:14.467053 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2065e4da-0138-48a6-a4a3-11a9827087cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:14.467914 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2065e4da-0138-48a6-a4a3-11a9827087cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:14.468424 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2065e4da-0138-48a6-a4a3-11a9827087cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:14.529510 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2065e4da-0138-48a6-a4a3-11a9827087cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:14.537014 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2065e4da-0138-48a6-a4a3-11a9827087cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1241 microversion: 2.1 time: 0.085277 Aug 30 07:48:14.537572 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 35/65] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:14 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:14.717706 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8ab1bc43-6174-49c4-b00c-a5c65b9b6fd5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:14.718363 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8ab1bc43-6174-49c4-b00c-a5c65b9b6fd5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:14.724298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8ab1bc43-6174-49c4-b00c-a5c65b9b6fd5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:14.724753 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8ab1bc43-6174-49c4-b00c-a5c65b9b6fd5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:14.725546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8ab1bc43-6174-49c4-b00c-a5c65b9b6fd5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:14.725986 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8ab1bc43-6174-49c4-b00c-a5c65b9b6fd5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:14.788615 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8ab1bc43-6174-49c4-b00c-a5c65b9b6fd5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:14.796158 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8ab1bc43-6174-49c4-b00c-a5c65b9b6fd5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1225 microversion: 2.1 time: 0.083066 Aug 30 07:48:14.797019 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 31/66] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:14 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:15.469909 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3fdbce52-730e-4944-ab18-54468c001f44 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:15.470597 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3fdbce52-730e-4944-ab18-54468c001f44 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:15.471068 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e80544fa-8b22-4208-98d0-522dc6025e4b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:15.472160 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e80544fa-8b22-4208-98d0-522dc6025e4b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:15.477298 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3fdbce52-730e-4944-ab18-54468c001f44 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:15.477746 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3fdbce52-730e-4944-ab18-54468c001f44 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:15.477950 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e80544fa-8b22-4208-98d0-522dc6025e4b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:15.478447 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e80544fa-8b22-4208-98d0-522dc6025e4b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:15.478585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3fdbce52-730e-4944-ab18-54468c001f44 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:15.478986 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3fdbce52-730e-4944-ab18-54468c001f44 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:15.479787 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e80544fa-8b22-4208-98d0-522dc6025e4b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:15.480387 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e80544fa-8b22-4208-98d0-522dc6025e4b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:15.611191 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e80544fa-8b22-4208-98d0-522dc6025e4b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:15.618617 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e80544fa-8b22-4208-98d0-522dc6025e4b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.151386 Aug 30 07:48:15.619191 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 32/67] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:15 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:15.624347 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3fdbce52-730e-4944-ab18-54468c001f44 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:15.627112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-dd21e043-ffb5-47c7-a8c7-fb78c6fbb92d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:15.627710 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-dd21e043-ffb5-47c7-a8c7-fb78c6fbb92d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:15.634194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd21e043-ffb5-47c7-a8c7-fb78c6fbb92d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:15.634867 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd21e043-ffb5-47c7-a8c7-fb78c6fbb92d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:15.636263 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd21e043-ffb5-47c7-a8c7-fb78c6fbb92d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:15.636693 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd21e043-ffb5-47c7-a8c7-fb78c6fbb92d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:15.641176 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3fdbce52-730e-4944-ab18-54468c001f44 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.174793 Aug 30 07:48:15.641906 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 36/68] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:15 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:15.701640 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-dd21e043-ffb5-47c7-a8c7-fb78c6fbb92d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:15.709020 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-dd21e043-ffb5-47c7-a8c7-fb78c6fbb92d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1241 microversion: 2.1 time: 0.088155 Aug 30 07:48:15.709575 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 33/69] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:15 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:15.813120 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-07605ca6-3b56-491f-b4bb-eb35184101a2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:15.813734 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-07605ca6-3b56-491f-b4bb-eb35184101a2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:15.819641 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07605ca6-3b56-491f-b4bb-eb35184101a2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:15.820384 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07605ca6-3b56-491f-b4bb-eb35184101a2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:15.821153 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07605ca6-3b56-491f-b4bb-eb35184101a2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:15.821581 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07605ca6-3b56-491f-b4bb-eb35184101a2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:15.883696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-07605ca6-3b56-491f-b4bb-eb35184101a2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:15.892669 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-07605ca6-3b56-491f-b4bb-eb35184101a2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1225 microversion: 2.1 time: 0.083093 Aug 30 07:48:15.893223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 37/70] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:15 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:16.637461 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b7b24462-1886-48b0-90b6-075d4f53f5f5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:16.638373 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b7b24462-1886-48b0-90b6-075d4f53f5f5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:16.644490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b7b24462-1886-48b0-90b6-075d4f53f5f5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:16.645221 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b7b24462-1886-48b0-90b6-075d4f53f5f5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:16.646465 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b7b24462-1886-48b0-90b6-075d4f53f5f5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:16.646977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b7b24462-1886-48b0-90b6-075d4f53f5f5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:16.657836 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bec9e974-e779-4cfe-add8-7b2c7b25cc24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:16.658537 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bec9e974-e779-4cfe-add8-7b2c7b25cc24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:16.664597 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bec9e974-e779-4cfe-add8-7b2c7b25cc24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:16.665052 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bec9e974-e779-4cfe-add8-7b2c7b25cc24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:16.665831 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bec9e974-e779-4cfe-add8-7b2c7b25cc24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:16.666304 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bec9e974-e779-4cfe-add8-7b2c7b25cc24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:16.826646 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b7b24462-1886-48b0-90b6-075d4f53f5f5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:16.841464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-bec9e974-e779-4cfe-add8-7b2c7b25cc24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:16.841607 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b7b24462-1886-48b0-90b6-075d4f53f5f5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.207491 Aug 30 07:48:16.842464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 34/71] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:16 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:16.846996 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-97a00a24-103f-441a-8eb4-7a2042c11573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:16.847612 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-97a00a24-103f-441a-8eb4-7a2042c11573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:16.848806 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bec9e974-e779-4cfe-add8-7b2c7b25cc24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.194561 Aug 30 07:48:16.849563 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 38/72] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:16 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:16.854725 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-97a00a24-103f-441a-8eb4-7a2042c11573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:16.855180 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-97a00a24-103f-441a-8eb4-7a2042c11573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:16.855958 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-97a00a24-103f-441a-8eb4-7a2042c11573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:16.856849 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-97a00a24-103f-441a-8eb4-7a2042c11573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:16.909772 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-09bfeaca-cc79-410b-9a02-cbd18f7c87fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:16.912962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-09bfeaca-cc79-410b-9a02-cbd18f7c87fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:16.920919 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-09bfeaca-cc79-410b-9a02-cbd18f7c87fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:16.921367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-09bfeaca-cc79-410b-9a02-cbd18f7c87fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:16.922492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-09bfeaca-cc79-410b-9a02-cbd18f7c87fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:16.923272 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-09bfeaca-cc79-410b-9a02-cbd18f7c87fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:16.954616 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-97a00a24-103f-441a-8eb4-7a2042c11573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:16.964262 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-97a00a24-103f-441a-8eb4-7a2042c11573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1241 microversion: 2.1 time: 0.119892 Aug 30 07:48:16.965116 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 35/73] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:16 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1241 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:17.013553 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-09bfeaca-cc79-410b-9a02-cbd18f7c87fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:17.021024 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-09bfeaca-cc79-410b-9a02-cbd18f7c87fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1225 microversion: 2.1 time: 0.114858 Aug 30 07:48:17.021594 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 39/74] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:16 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:17.871020 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-be6dbd81-bc2b-47cd-91b8-52c8032013ee tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:17.872429 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f0c50535-74f5-4ef3-8059-80794d420f8b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:17.876483 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f0c50535-74f5-4ef3-8059-80794d420f8b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:17.876917 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-be6dbd81-bc2b-47cd-91b8-52c8032013ee tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:17.897230 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-be6dbd81-bc2b-47cd-91b8-52c8032013ee tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:17.898735 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f0c50535-74f5-4ef3-8059-80794d420f8b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:17.899626 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f0c50535-74f5-4ef3-8059-80794d420f8b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:17.900497 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-be6dbd81-bc2b-47cd-91b8-52c8032013ee tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:17.903407 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f0c50535-74f5-4ef3-8059-80794d420f8b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:17.904113 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-be6dbd81-bc2b-47cd-91b8-52c8032013ee tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:17.904945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-be6dbd81-bc2b-47cd-91b8-52c8032013ee tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:17.906900 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f0c50535-74f5-4ef3-8059-80794d420f8b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:18.211269 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f0c50535-74f5-4ef3-8059-80794d420f8b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:18.230810 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f0c50535-74f5-4ef3-8059-80794d420f8b tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.373044 Aug 30 07:48:18.234214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 36/75] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:17 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:18.248937 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-65be989f-a8eb-434f-9925-f0cf2b20c1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:18.251713 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-65be989f-a8eb-434f-9925-f0cf2b20c1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:18.271556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65be989f-a8eb-434f-9925-f0cf2b20c1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:18.273305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65be989f-a8eb-434f-9925-f0cf2b20c1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:18.274901 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65be989f-a8eb-434f-9925-f0cf2b20c1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:18.275562 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65be989f-a8eb-434f-9925-f0cf2b20c1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:18.452272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-65be989f-a8eb-434f-9925-f0cf2b20c1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:18.475681 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-65be989f-a8eb-434f-9925-f0cf2b20c1d4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1233 microversion: 2.1 time: 0.239329 Aug 30 07:48:18.477181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 37/76] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:18 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1233 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:18.497681 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3303dd55-08a4-4ac0-98df-6033f4cf34d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:18.499187 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3303dd55-08a4-4ac0-98df-6033f4cf34d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:18.515658 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3303dd55-08a4-4ac0-98df-6033f4cf34d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:18.516107 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3303dd55-08a4-4ac0-98df-6033f4cf34d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:18.520504 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3303dd55-08a4-4ac0-98df-6033f4cf34d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:18.521916 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3303dd55-08a4-4ac0-98df-6033f4cf34d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:18.593207 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-be6dbd81-bc2b-47cd-91b8-52c8032013ee tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:18.602674 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-be6dbd81-bc2b-47cd-91b8-52c8032013ee tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.740324 Aug 30 07:48:18.607397 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 40/77] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:17 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:18.824161 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3303dd55-08a4-4ac0-98df-6033f4cf34d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:18.844564 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3303dd55-08a4-4ac0-98df-6033f4cf34d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1291 microversion: 2.1 time: 0.363428 Aug 30 07:48:18.845530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 38/78] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:18 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1291 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:19.250606 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b7e1c1bb-ab4f-4c9e-bbdb-f1aa1f710304 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:19.251932 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b7e1c1bb-ab4f-4c9e-bbdb-f1aa1f710304 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:19.270133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b7e1c1bb-ab4f-4c9e-bbdb-f1aa1f710304 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:19.270994 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b7e1c1bb-ab4f-4c9e-bbdb-f1aa1f710304 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:19.272173 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b7e1c1bb-ab4f-4c9e-bbdb-f1aa1f710304 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:19.272963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b7e1c1bb-ab4f-4c9e-bbdb-f1aa1f710304 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:19.497788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-350f8e57-9b27-422f-b3ff-1bc96f18554e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:19.498690 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-350f8e57-9b27-422f-b3ff-1bc96f18554e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:19.507734 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-350f8e57-9b27-422f-b3ff-1bc96f18554e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:19.509377 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-350f8e57-9b27-422f-b3ff-1bc96f18554e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:19.512507 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-350f8e57-9b27-422f-b3ff-1bc96f18554e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:19.513711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-350f8e57-9b27-422f-b3ff-1bc96f18554e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:19.625378 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-350f8e57-9b27-422f-b3ff-1bc96f18554e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:19.640576 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-350f8e57-9b27-422f-b3ff-1bc96f18554e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1295 microversion: 2.1 time: 0.147332 Aug 30 07:48:19.642223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 39/79] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:19 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1295 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:19.647851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3134aa21-e577-4848-9377-ce0e3752e731 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:19.648458 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3134aa21-e577-4848-9377-ce0e3752e731 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:19.670676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3134aa21-e577-4848-9377-ce0e3752e731 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:19.672803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3134aa21-e577-4848-9377-ce0e3752e731 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:19.675930 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3134aa21-e577-4848-9377-ce0e3752e731 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:19.676717 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3134aa21-e577-4848-9377-ce0e3752e731 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:19.763375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b7e1c1bb-ab4f-4c9e-bbdb-f1aa1f710304 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:19.780031 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b7e1c1bb-ab4f-4c9e-bbdb-f1aa1f710304 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.530689 Aug 30 07:48:19.781642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 41/80] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:19 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:19.862099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-af831d9e-ba65-4793-b951-89a5c204ae1c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:19.862822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-af831d9e-ba65-4793-b951-89a5c204ae1c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:19.871968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af831d9e-ba65-4793-b951-89a5c204ae1c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:19.872440 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af831d9e-ba65-4793-b951-89a5c204ae1c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:19.873248 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af831d9e-ba65-4793-b951-89a5c204ae1c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:19.873685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af831d9e-ba65-4793-b951-89a5c204ae1c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:19.993735 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-af831d9e-ba65-4793-b951-89a5c204ae1c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:20.000300 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3134aa21-e577-4848-9377-ce0e3752e731 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:20.005900 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-af831d9e-ba65-4793-b951-89a5c204ae1c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1279 microversion: 2.1 time: 0.147154 Aug 30 07:48:20.009274 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3134aa21-e577-4848-9377-ce0e3752e731 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.365216 Aug 30 07:48:20.012456 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 40/81] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:19 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:20.018257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 42/82] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:19 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:20.665954 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f7180d6e-4c1c-4a25-93e7-e2e47639a6de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:20.667856 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f7180d6e-4c1c-4a25-93e7-e2e47639a6de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:20.678846 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f7180d6e-4c1c-4a25-93e7-e2e47639a6de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:20.679305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f7180d6e-4c1c-4a25-93e7-e2e47639a6de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:20.680181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f7180d6e-4c1c-4a25-93e7-e2e47639a6de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:20.681669 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f7180d6e-4c1c-4a25-93e7-e2e47639a6de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:20.802925 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-856c7395-b5da-4a3f-b6ee-887ab55e4afc tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:20.806026 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-856c7395-b5da-4a3f-b6ee-887ab55e4afc tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:20.824609 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-856c7395-b5da-4a3f-b6ee-887ab55e4afc tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:20.826509 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-856c7395-b5da-4a3f-b6ee-887ab55e4afc tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:20.834894 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-856c7395-b5da-4a3f-b6ee-887ab55e4afc tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:20.835968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-856c7395-b5da-4a3f-b6ee-887ab55e4afc tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:21.090683 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f7180d6e-4c1c-4a25-93e7-e2e47639a6de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:21.099934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f7180d6e-4c1c-4a25-93e7-e2e47639a6de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.439424 Aug 30 07:48:21.101381 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 41/83] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:20 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:21.108157 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3c093052-f414-400f-813d-3bdee595e7dc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:21.109473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3c093052-f414-400f-813d-3bdee595e7dc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:21.119024 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3c093052-f414-400f-813d-3bdee595e7dc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:21.120300 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3c093052-f414-400f-813d-3bdee595e7dc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:21.121783 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3c093052-f414-400f-813d-3bdee595e7dc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:21.122540 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3c093052-f414-400f-813d-3bdee595e7dc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:21.389812 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3c093052-f414-400f-813d-3bdee595e7dc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:21.404591 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3c093052-f414-400f-813d-3bdee595e7dc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.300237 Aug 30 07:48:21.407361 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 42/84] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:21 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:21.414976 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a2c6a1ab-5247-4b2d-8080-eb921811dc11 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:21.415961 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a2c6a1ab-5247-4b2d-8080-eb921811dc11 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:21.425129 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a2c6a1ab-5247-4b2d-8080-eb921811dc11 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:21.425844 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a2c6a1ab-5247-4b2d-8080-eb921811dc11 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:21.427220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a2c6a1ab-5247-4b2d-8080-eb921811dc11 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:21.428010 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a2c6a1ab-5247-4b2d-8080-eb921811dc11 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:21.512168 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-856c7395-b5da-4a3f-b6ee-887ab55e4afc tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:21.524140 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-856c7395-b5da-4a3f-b6ee-887ab55e4afc tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.729147 Aug 30 07:48:21.533952 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 43/85] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:20 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:21.693997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a2c6a1ab-5247-4b2d-8080-eb921811dc11 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:21.704794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a2c6a1ab-5247-4b2d-8080-eb921811dc11 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.295399 Aug 30 07:48:21.714207 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-ac4bd4f1-460d-4cbd-ad23-9163cedc83e8 req-d73a3660-23d4-40b7-9696-3c63229d6758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95fc5a1e-6b49-475e-85ec-93d172a0d3e2", "tag": "ae18f657-8bf1-4e50-b57d-7f58cd1f4360"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:21.716118 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:48:21.716118 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:48:21.718922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 43/86] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:21 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:21.731805 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-ac4bd4f1-460d-4cbd-ad23-9163cedc83e8 req-d73a3660-23d4-40b7-9696-3c63229d6758 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:21.732349 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-ac4bd4f1-460d-4cbd-ad23-9163cedc83e8 req-d73a3660-23d4-40b7-9696-3c63229d6758 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:21.746132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-ac4bd4f1-460d-4cbd-ad23-9163cedc83e8 req-d73a3660-23d4-40b7-9696-3c63229d6758 service nova] Creating event network-changed:ae18f657-8bf1-4e50-b57d-7f58cd1f4360 for instance 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 on hv-cinder-80619 Aug 30 07:48:21.751553 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-ac4bd4f1-460d-4cbd-ad23-9163cedc83e8 req-d73a3660-23d4-40b7-9696-3c63229d6758 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222917 Aug 30 07:48:21.752496 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 44/87] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:48:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:48:22.123740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-19824ec8-bac5-4558-8bbc-215aae5adc70 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:22.124375 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-19824ec8-bac5-4558-8bbc-215aae5adc70 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:22.134132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-19824ec8-bac5-4558-8bbc-215aae5adc70 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:22.135415 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-19824ec8-bac5-4558-8bbc-215aae5adc70 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:22.136147 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-19824ec8-bac5-4558-8bbc-215aae5adc70 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:22.136542 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-19824ec8-bac5-4558-8bbc-215aae5adc70 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:22.349873 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-19824ec8-bac5-4558-8bbc-215aae5adc70 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:22.357588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-19824ec8-bac5-4558-8bbc-215aae5adc70 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.244503 Aug 30 07:48:22.358194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 44/88] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:22 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:22.375054 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-3a5c9d18-42fd-4e0c-bb8c-2624f201078e req-02848e87-be3a-4338-8a06-f22085899536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab74e53e-3def-4d56-a5a3-9bdaae91e894", "tag": "7df2dfe2-84f3-44d6-9b60-1cece886854d"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:22.377153 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:48:22.377153 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:48:22.387818 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-3a5c9d18-42fd-4e0c-bb8c-2624f201078e req-02848e87-be3a-4338-8a06-f22085899536 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:22.388319 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-3a5c9d18-42fd-4e0c-bb8c-2624f201078e req-02848e87-be3a-4338-8a06-f22085899536 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:22.401078 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-3a5c9d18-42fd-4e0c-bb8c-2624f201078e req-02848e87-be3a-4338-8a06-f22085899536 service nova] Creating event network-changed:7df2dfe2-84f3-44d6-9b60-1cece886854d for instance ab74e53e-3def-4d56-a5a3-9bdaae91e894 on hv-cinder-80619 Aug 30 07:48:22.406078 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-3a5c9d18-42fd-4e0c-bb8c-2624f201078e req-02848e87-be3a-4338-8a06-f22085899536 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037553 Aug 30 07:48:22.406968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 45/89] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:48:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:48:22.424920 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-697c543c-4050-47fb-a718-9d2ce27858e1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:22.425627 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-697c543c-4050-47fb-a718-9d2ce27858e1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:22.431620 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-697c543c-4050-47fb-a718-9d2ce27858e1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:22.432830 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-697c543c-4050-47fb-a718-9d2ce27858e1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:22.433980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-697c543c-4050-47fb-a718-9d2ce27858e1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:22.434524 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-697c543c-4050-47fb-a718-9d2ce27858e1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:22.543165 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c46f107b-9ef5-45c2-9258-487b4c665fd5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:22.543819 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c46f107b-9ef5-45c2-9258-487b4c665fd5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:22.552003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c46f107b-9ef5-45c2-9258-487b4c665fd5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:22.553001 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c46f107b-9ef5-45c2-9258-487b4c665fd5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:22.554806 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c46f107b-9ef5-45c2-9258-487b4c665fd5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:22.555582 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c46f107b-9ef5-45c2-9258-487b4c665fd5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:22.598487 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-697c543c-4050-47fb-a718-9d2ce27858e1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:22.612268 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-697c543c-4050-47fb-a718-9d2ce27858e1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.191715 Aug 30 07:48:22.626717 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 45/90] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:22 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:22.735379 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ed89637c-b6b2-4888-b7ef-eacc42ccc99b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:22.735873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c46f107b-9ef5-45c2-9258-487b4c665fd5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:22.735994 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ed89637c-b6b2-4888-b7ef-eacc42ccc99b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:22.747684 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed89637c-b6b2-4888-b7ef-eacc42ccc99b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:22.748133 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed89637c-b6b2-4888-b7ef-eacc42ccc99b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:22.749214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed89637c-b6b2-4888-b7ef-eacc42ccc99b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:22.750371 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed89637c-b6b2-4888-b7ef-eacc42ccc99b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:22.751787 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c46f107b-9ef5-45c2-9258-487b4c665fd5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.213809 Aug 30 07:48:22.773412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 46/91] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:22 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:22.989230 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ed89637c-b6b2-4888-b7ef-eacc42ccc99b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:22.999603 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ed89637c-b6b2-4888-b7ef-eacc42ccc99b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.267708 Aug 30 07:48:23.000661 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 46/92] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:22 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:23.381369 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-342a78fe-f706-4ffe-bfa6-9808d7bf72ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:23.382115 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-342a78fe-f706-4ffe-bfa6-9808d7bf72ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:23.390473 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-342a78fe-f706-4ffe-bfa6-9808d7bf72ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:23.391216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-342a78fe-f706-4ffe-bfa6-9808d7bf72ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:23.392389 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-342a78fe-f706-4ffe-bfa6-9808d7bf72ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:23.392962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-342a78fe-f706-4ffe-bfa6-9808d7bf72ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:23.521623 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-342a78fe-f706-4ffe-bfa6-9808d7bf72ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:23.529370 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-342a78fe-f706-4ffe-bfa6-9808d7bf72ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.153366 Aug 30 07:48:23.529941 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 47/93] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:23 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:23.638121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c545a7f4-7421-4f86-91b1-a75c42d2869e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:23.638820 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c545a7f4-7421-4f86-91b1-a75c42d2869e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:23.644558 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c545a7f4-7421-4f86-91b1-a75c42d2869e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:23.645026 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c545a7f4-7421-4f86-91b1-a75c42d2869e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:23.645768 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c545a7f4-7421-4f86-91b1-a75c42d2869e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:23.646238 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c545a7f4-7421-4f86-91b1-a75c42d2869e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:23.771397 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5d215914-0b5c-47fd-b5ae-5530d14c6391 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:23.772495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5d215914-0b5c-47fd-b5ae-5530d14c6391 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:23.775142 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c545a7f4-7421-4f86-91b1-a75c42d2869e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:23.779074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d215914-0b5c-47fd-b5ae-5530d14c6391 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:23.779529 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d215914-0b5c-47fd-b5ae-5530d14c6391 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:23.780312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d215914-0b5c-47fd-b5ae-5530d14c6391 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:23.780752 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d215914-0b5c-47fd-b5ae-5530d14c6391 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:23.783559 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c545a7f4-7421-4f86-91b1-a75c42d2869e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.150003 Aug 30 07:48:23.784146 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 47/94] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:23 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:23.926823 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5d215914-0b5c-47fd-b5ae-5530d14c6391 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:23.934970 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5d215914-0b5c-47fd-b5ae-5530d14c6391 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.167235 Aug 30 07:48:23.935635 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 48/95] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:23 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:24.017119 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-115483a6-94ad-4e94-a612-1aff1f3082a6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:24.017739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-115483a6-94ad-4e94-a612-1aff1f3082a6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:24.023882 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-115483a6-94ad-4e94-a612-1aff1f3082a6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:24.024326 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-115483a6-94ad-4e94-a612-1aff1f3082a6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:24.025129 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-115483a6-94ad-4e94-a612-1aff1f3082a6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:24.026103 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-115483a6-94ad-4e94-a612-1aff1f3082a6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:24.173385 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-115483a6-94ad-4e94-a612-1aff1f3082a6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:24.185810 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-115483a6-94ad-4e94-a612-1aff1f3082a6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.172350 Aug 30 07:48:24.195804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 48/96] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:24 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:24.423593 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-a76c34d7-4204-461b-82e3-c4233e366fe8 req-52262787-5ba4-4e6b-a61b-ceae1e318b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63042c8c-43ca-4d02-8ef2-07a08833cdf1", "tag": "03f5aee7-d6fd-4ea0-b19a-d088da242d0e"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:24.425227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:48:24.425227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:48:24.434062 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-a76c34d7-4204-461b-82e3-c4233e366fe8 req-52262787-5ba4-4e6b-a61b-ceae1e318b54 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:24.434548 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-a76c34d7-4204-461b-82e3-c4233e366fe8 req-52262787-5ba4-4e6b-a61b-ceae1e318b54 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:24.446161 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-a76c34d7-4204-461b-82e3-c4233e366fe8 req-52262787-5ba4-4e6b-a61b-ceae1e318b54 service nova] Creating event network-changed:03f5aee7-d6fd-4ea0-b19a-d088da242d0e for instance 63042c8c-43ca-4d02-8ef2-07a08833cdf1 on hv-cinder-80619 Aug 30 07:48:24.454419 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-a76c34d7-4204-461b-82e3-c4233e366fe8 req-52262787-5ba4-4e6b-a61b-ceae1e318b54 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032419 Aug 30 07:48:24.454419 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 49/97] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:48:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:48:24.547905 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e5e34b44-882c-44d9-ab08-8b3446366bcf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:24.548529 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e5e34b44-882c-44d9-ab08-8b3446366bcf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:24.555317 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e5e34b44-882c-44d9-ab08-8b3446366bcf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:24.555861 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e5e34b44-882c-44d9-ab08-8b3446366bcf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:24.557472 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e5e34b44-882c-44d9-ab08-8b3446366bcf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:24.558246 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e5e34b44-882c-44d9-ab08-8b3446366bcf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:24.696038 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e5e34b44-882c-44d9-ab08-8b3446366bcf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:24.716038 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e5e34b44-882c-44d9-ab08-8b3446366bcf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.171726 Aug 30 07:48:24.716929 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 49/98] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:24 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:24.801273 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d9b30260-d661-419a-8b85-92c50b62b673 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:24.801985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d9b30260-d661-419a-8b85-92c50b62b673 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:24.808843 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9b30260-d661-419a-8b85-92c50b62b673 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:24.809395 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9b30260-d661-419a-8b85-92c50b62b673 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:24.810088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9b30260-d661-419a-8b85-92c50b62b673 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:24.810556 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9b30260-d661-419a-8b85-92c50b62b673 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:24.953645 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-25dbc6d9-1e52-41bd-8704-7c638ceef80f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:24.955077 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-25dbc6d9-1e52-41bd-8704-7c638ceef80f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:24.964326 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-25dbc6d9-1e52-41bd-8704-7c638ceef80f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:24.965425 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-25dbc6d9-1e52-41bd-8704-7c638ceef80f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:24.967329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-25dbc6d9-1e52-41bd-8704-7c638ceef80f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:24.968633 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-25dbc6d9-1e52-41bd-8704-7c638ceef80f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:24.969447 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d9b30260-d661-419a-8b85-92c50b62b673 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:24.978891 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d9b30260-d661-419a-8b85-92c50b62b673 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.181336 Aug 30 07:48:24.979631 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 50/99] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:24 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:25.110053 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-25dbc6d9-1e52-41bd-8704-7c638ceef80f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:25.117404 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-25dbc6d9-1e52-41bd-8704-7c638ceef80f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.167479 Aug 30 07:48:25.123681 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 50/100] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:24 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:25.203181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9d49536b-9147-44ab-a388-357cf9d06e47 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:25.203855 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9d49536b-9147-44ab-a388-357cf9d06e47 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:25.209892 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d49536b-9147-44ab-a388-357cf9d06e47 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:25.210388 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d49536b-9147-44ab-a388-357cf9d06e47 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:25.211155 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d49536b-9147-44ab-a388-357cf9d06e47 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:25.211588 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d49536b-9147-44ab-a388-357cf9d06e47 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:25.364333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9d49536b-9147-44ab-a388-357cf9d06e47 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:25.372378 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9d49536b-9147-44ab-a388-357cf9d06e47 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.173348 Aug 30 07:48:25.373038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 51/101] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:25 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:25.732988 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6aeceb94-7587-4ecf-83ad-09fa917d8465 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:25.733864 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6aeceb94-7587-4ecf-83ad-09fa917d8465 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:25.739895 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6aeceb94-7587-4ecf-83ad-09fa917d8465 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:25.740415 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6aeceb94-7587-4ecf-83ad-09fa917d8465 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:25.741194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6aeceb94-7587-4ecf-83ad-09fa917d8465 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:25.741630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6aeceb94-7587-4ecf-83ad-09fa917d8465 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:25.902685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6aeceb94-7587-4ecf-83ad-09fa917d8465 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:25.911196 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6aeceb94-7587-4ecf-83ad-09fa917d8465 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.181819 Aug 30 07:48:25.911732 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 51/102] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:25 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:25.997025 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d9f83b5f-10ab-4a47-b69c-8b1cc64058c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:25.997651 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d9f83b5f-10ab-4a47-b69c-8b1cc64058c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:26.011037 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9f83b5f-10ab-4a47-b69c-8b1cc64058c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:26.011470 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9f83b5f-10ab-4a47-b69c-8b1cc64058c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:26.012338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9f83b5f-10ab-4a47-b69c-8b1cc64058c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:26.012670 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9f83b5f-10ab-4a47-b69c-8b1cc64058c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:26.143004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-66837d20-2d06-4fb3-9f76-3508fec42d73 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:26.147909 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-66837d20-2d06-4fb3-9f76-3508fec42d73 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:26.149886 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d9f83b5f-10ab-4a47-b69c-8b1cc64058c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:26.155426 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-66837d20-2d06-4fb3-9f76-3508fec42d73 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:26.155963 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-66837d20-2d06-4fb3-9f76-3508fec42d73 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:26.156755 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-66837d20-2d06-4fb3-9f76-3508fec42d73 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:26.157194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-66837d20-2d06-4fb3-9f76-3508fec42d73 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:26.158136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d9f83b5f-10ab-4a47-b69c-8b1cc64058c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.164945 Aug 30 07:48:26.158765 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 52/103] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:25 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:26.305889 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-66837d20-2d06-4fb3-9f76-3508fec42d73 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:26.323531 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-66837d20-2d06-4fb3-9f76-3508fec42d73 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.186908 Aug 30 07:48:26.324369 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 52/104] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:26 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:26.390113 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-97c7683e-01e4-4a42-be54-042a2f636fa2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:26.391405 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-97c7683e-01e4-4a42-be54-042a2f636fa2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:26.400009 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-97c7683e-01e4-4a42-be54-042a2f636fa2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:26.400400 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-97c7683e-01e4-4a42-be54-042a2f636fa2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:26.401708 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-97c7683e-01e4-4a42-be54-042a2f636fa2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:26.402184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-97c7683e-01e4-4a42-be54-042a2f636fa2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:26.836484 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-97c7683e-01e4-4a42-be54-042a2f636fa2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:26.845565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-97c7683e-01e4-4a42-be54-042a2f636fa2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.460370 Aug 30 07:48:26.852494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 53/105] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:26 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:26.927791 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e025d401-c935-4d55-854e-b94d4f1451a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:26.928418 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e025d401-c935-4d55-854e-b94d4f1451a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:26.934964 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e025d401-c935-4d55-854e-b94d4f1451a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:26.935522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e025d401-c935-4d55-854e-b94d4f1451a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:26.936378 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e025d401-c935-4d55-854e-b94d4f1451a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:26.936888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e025d401-c935-4d55-854e-b94d4f1451a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:27.135411 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e025d401-c935-4d55-854e-b94d4f1451a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:27.143105 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e025d401-c935-4d55-854e-b94d4f1451a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.219023 Aug 30 07:48:27.143788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 53/106] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:26 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:27.174586 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4271ff3d-a0d2-4aef-98a0-280fa7f56a14 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:27.175202 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4271ff3d-a0d2-4aef-98a0-280fa7f56a14 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:27.181251 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4271ff3d-a0d2-4aef-98a0-280fa7f56a14 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:27.182059 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4271ff3d-a0d2-4aef-98a0-280fa7f56a14 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:27.182799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4271ff3d-a0d2-4aef-98a0-280fa7f56a14 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:27.183241 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4271ff3d-a0d2-4aef-98a0-280fa7f56a14 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:27.341752 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-17861ebf-60f5-4a26-b11a-657975391b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:27.342495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-17861ebf-60f5-4a26-b11a-657975391b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:27.351728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-17861ebf-60f5-4a26-b11a-657975391b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:27.351728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-17861ebf-60f5-4a26-b11a-657975391b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:27.351728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-17861ebf-60f5-4a26-b11a-657975391b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:27.351728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-17861ebf-60f5-4a26-b11a-657975391b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:27.523027 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-17861ebf-60f5-4a26-b11a-657975391b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:27.534641 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-17861ebf-60f5-4a26-b11a-657975391b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.197385 Aug 30 07:48:27.535821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 54/107] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:27 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:27.832468 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4271ff3d-a0d2-4aef-98a0-280fa7f56a14 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:27.847412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4271ff3d-a0d2-4aef-98a0-280fa7f56a14 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.671585 Aug 30 07:48:27.847412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 54/108] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:27 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:27.864303 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9683cba2-c5f3-4a52-9486-9a0761146939 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:27.865290 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9683cba2-c5f3-4a52-9486-9a0761146939 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:27.877140 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9683cba2-c5f3-4a52-9486-9a0761146939 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:27.877603 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9683cba2-c5f3-4a52-9486-9a0761146939 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:27.883220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9683cba2-c5f3-4a52-9486-9a0761146939 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:27.887223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9683cba2-c5f3-4a52-9486-9a0761146939 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:28.162200 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d27f16d5-dba5-46c0-ba72-22ac0b9e04c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:28.162709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d27f16d5-dba5-46c0-ba72-22ac0b9e04c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:28.173363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d27f16d5-dba5-46c0-ba72-22ac0b9e04c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:28.173793 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d27f16d5-dba5-46c0-ba72-22ac0b9e04c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:28.174620 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d27f16d5-dba5-46c0-ba72-22ac0b9e04c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:28.175486 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d27f16d5-dba5-46c0-ba72-22ac0b9e04c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:28.215739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9683cba2-c5f3-4a52-9486-9a0761146939 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:28.226086 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9683cba2-c5f3-4a52-9486-9a0761146939 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.366745 Aug 30 07:48:28.238726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 55/109] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:27 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:28.519894 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d27f16d5-dba5-46c0-ba72-22ac0b9e04c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:28.532223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d27f16d5-dba5-46c0-ba72-22ac0b9e04c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.373935 Aug 30 07:48:28.533539 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 55/110] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:28 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:28.554743 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c3e80ac5-6c77-4a19-a59e-13be94dcd7fb tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:28.555854 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c3e80ac5-6c77-4a19-a59e-13be94dcd7fb tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:28.564723 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c3e80ac5-6c77-4a19-a59e-13be94dcd7fb tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:28.565973 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c3e80ac5-6c77-4a19-a59e-13be94dcd7fb tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:28.567136 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c3e80ac5-6c77-4a19-a59e-13be94dcd7fb tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:28.567770 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c3e80ac5-6c77-4a19-a59e-13be94dcd7fb tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:28.767589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c3e80ac5-6c77-4a19-a59e-13be94dcd7fb tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:28.780239 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c3e80ac5-6c77-4a19-a59e-13be94dcd7fb tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.231095 Aug 30 07:48:28.781333 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 56/111] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:28 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:28.859443 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f3c31271-1282-4237-98dd-e371cfdfa479 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:28.860038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f3c31271-1282-4237-98dd-e371cfdfa479 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:28.866875 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3c31271-1282-4237-98dd-e371cfdfa479 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:28.867343 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3c31271-1282-4237-98dd-e371cfdfa479 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:28.868121 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3c31271-1282-4237-98dd-e371cfdfa479 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:28.868556 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3c31271-1282-4237-98dd-e371cfdfa479 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:29.096368 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f3c31271-1282-4237-98dd-e371cfdfa479 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:29.112301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f3c31271-1282-4237-98dd-e371cfdfa479 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.257060 Aug 30 07:48:29.112965 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 56/112] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:28 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:29.248118 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fd1c00f1-5422-480f-8c6a-fed8253e50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:29.248727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fd1c00f1-5422-480f-8c6a-fed8253e50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:29.255860 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fd1c00f1-5422-480f-8c6a-fed8253e50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:29.257493 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fd1c00f1-5422-480f-8c6a-fed8253e50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:29.259136 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fd1c00f1-5422-480f-8c6a-fed8253e50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:29.260910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fd1c00f1-5422-480f-8c6a-fed8253e50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:29.487129 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-fd1c00f1-5422-480f-8c6a-fed8253e50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:29.497637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fd1c00f1-5422-480f-8c6a-fed8253e50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.254041 Aug 30 07:48:29.501596 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 57/113] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:29 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:29.554265 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7eb1c212-3087-4af6-983d-412faaf086a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:29.556081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7eb1c212-3087-4af6-983d-412faaf086a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:29.578939 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7eb1c212-3087-4af6-983d-412faaf086a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:29.579589 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7eb1c212-3087-4af6-983d-412faaf086a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:29.580475 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7eb1c212-3087-4af6-983d-412faaf086a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:29.580932 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7eb1c212-3087-4af6-983d-412faaf086a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:29.778370 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7eb1c212-3087-4af6-983d-412faaf086a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:29.786229 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7eb1c212-3087-4af6-983d-412faaf086a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.238930 Aug 30 07:48:29.786863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 57/114] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:29 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:29.804180 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a46d3db7-8e4a-4ccf-8a56-d1822d3242b3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:29.804797 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a46d3db7-8e4a-4ccf-8a56-d1822d3242b3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:29.815245 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a46d3db7-8e4a-4ccf-8a56-d1822d3242b3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:29.815547 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a46d3db7-8e4a-4ccf-8a56-d1822d3242b3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:29.816653 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a46d3db7-8e4a-4ccf-8a56-d1822d3242b3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:29.818106 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a46d3db7-8e4a-4ccf-8a56-d1822d3242b3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:29.967218 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a46d3db7-8e4a-4ccf-8a56-d1822d3242b3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:29.974886 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a46d3db7-8e4a-4ccf-8a56-d1822d3242b3 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.175310 Aug 30 07:48:29.975761 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 58/115] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:29 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:30.129771 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-057d3e42-1136-43a8-baef-6ed6d5da071f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:30.130531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-057d3e42-1136-43a8-baef-6ed6d5da071f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:30.138721 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-057d3e42-1136-43a8-baef-6ed6d5da071f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:30.138721 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-057d3e42-1136-43a8-baef-6ed6d5da071f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:30.138721 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-057d3e42-1136-43a8-baef-6ed6d5da071f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:30.138938 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-057d3e42-1136-43a8-baef-6ed6d5da071f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:30.294291 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-057d3e42-1136-43a8-baef-6ed6d5da071f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:30.302985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-057d3e42-1136-43a8-baef-6ed6d5da071f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.177572 Aug 30 07:48:30.306395 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 58/116] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:30 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:30.517786 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8beefe9c-ab7e-4691-9b58-9b90a15b14af tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:30.518515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8beefe9c-ab7e-4691-9b58-9b90a15b14af tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:30.525219 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8beefe9c-ab7e-4691-9b58-9b90a15b14af tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:30.526294 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8beefe9c-ab7e-4691-9b58-9b90a15b14af tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:30.527083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8beefe9c-ab7e-4691-9b58-9b90a15b14af tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:30.527541 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8beefe9c-ab7e-4691-9b58-9b90a15b14af tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:30.673611 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8beefe9c-ab7e-4691-9b58-9b90a15b14af tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:30.682448 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8beefe9c-ab7e-4691-9b58-9b90a15b14af tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.167332 Aug 30 07:48:30.683462 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 59/117] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:30 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:30.807873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9c1ab6da-20ad-41f3-8229-fff39a562607 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:30.808537 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9c1ab6da-20ad-41f3-8229-fff39a562607 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:30.818375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c1ab6da-20ad-41f3-8229-fff39a562607 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:30.818375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c1ab6da-20ad-41f3-8229-fff39a562607 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:30.818375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c1ab6da-20ad-41f3-8229-fff39a562607 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:30.818375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c1ab6da-20ad-41f3-8229-fff39a562607 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:30.979900 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9c1ab6da-20ad-41f3-8229-fff39a562607 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:30.988956 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9c1ab6da-20ad-41f3-8229-fff39a562607 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.186747 Aug 30 07:48:30.989773 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 59/118] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:30 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:30.993328 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-655a0388-9fdd-47f1-8c80-23ce4fb1bab0 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:30.994818 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-655a0388-9fdd-47f1-8c80-23ce4fb1bab0 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:31.004137 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-655a0388-9fdd-47f1-8c80-23ce4fb1bab0 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:31.004606 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-655a0388-9fdd-47f1-8c80-23ce4fb1bab0 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:31.005562 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-655a0388-9fdd-47f1-8c80-23ce4fb1bab0 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:31.006199 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-655a0388-9fdd-47f1-8c80-23ce4fb1bab0 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:31.197089 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-655a0388-9fdd-47f1-8c80-23ce4fb1bab0 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:31.205137 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-655a0388-9fdd-47f1-8c80-23ce4fb1bab0 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.215985 Aug 30 07:48:31.205910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 60/119] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:30 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:31.319457 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6d34807d-d1e9-46ee-91bc-d42b020e7959 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:31.320550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6d34807d-d1e9-46ee-91bc-d42b020e7959 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:31.329271 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d34807d-d1e9-46ee-91bc-d42b020e7959 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:31.329883 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d34807d-d1e9-46ee-91bc-d42b020e7959 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:31.330820 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d34807d-d1e9-46ee-91bc-d42b020e7959 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:31.331391 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d34807d-d1e9-46ee-91bc-d42b020e7959 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:31.473198 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6d34807d-d1e9-46ee-91bc-d42b020e7959 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:31.481829 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6d34807d-d1e9-46ee-91bc-d42b020e7959 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.166204 Aug 30 07:48:31.482869 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 60/120] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:31 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:31.699906 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7174b036-f8aa-4e20-95bc-30444dbb5601 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:31.701588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7174b036-f8aa-4e20-95bc-30444dbb5601 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:31.709345 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7174b036-f8aa-4e20-95bc-30444dbb5601 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:31.710113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7174b036-f8aa-4e20-95bc-30444dbb5601 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:31.711069 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7174b036-f8aa-4e20-95bc-30444dbb5601 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:31.711646 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7174b036-f8aa-4e20-95bc-30444dbb5601 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:31.855990 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7174b036-f8aa-4e20-95bc-30444dbb5601 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:31.863178 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7174b036-f8aa-4e20-95bc-30444dbb5601 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.166986 Aug 30 07:48:31.864014 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 61/121] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:31 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:32.008028 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2a3506ea-0448-4342-8ebc-c28518c8ec54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:32.008601 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2a3506ea-0448-4342-8ebc-c28518c8ec54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:32.015613 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2a3506ea-0448-4342-8ebc-c28518c8ec54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:32.015997 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2a3506ea-0448-4342-8ebc-c28518c8ec54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:32.016773 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2a3506ea-0448-4342-8ebc-c28518c8ec54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:32.017237 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2a3506ea-0448-4342-8ebc-c28518c8ec54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:32.159421 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2a3506ea-0448-4342-8ebc-c28518c8ec54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:32.169837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2a3506ea-0448-4342-8ebc-c28518c8ec54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.165573 Aug 30 07:48:32.170703 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 61/122] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:32 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:32.222410 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ef2c6fbf-70f3-44bf-abf9-66ba649ad61f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:32.223023 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ef2c6fbf-70f3-44bf-abf9-66ba649ad61f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:32.229618 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef2c6fbf-70f3-44bf-abf9-66ba649ad61f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:32.230178 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef2c6fbf-70f3-44bf-abf9-66ba649ad61f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:32.230968 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef2c6fbf-70f3-44bf-abf9-66ba649ad61f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:32.231446 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef2c6fbf-70f3-44bf-abf9-66ba649ad61f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:32.389660 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ef2c6fbf-70f3-44bf-abf9-66ba649ad61f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:32.397003 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ef2c6fbf-70f3-44bf-abf9-66ba649ad61f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.178201 Aug 30 07:48:32.397537 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 62/123] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:32 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:32.500015 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-49fa16ca-b847-4aba-8068-8f4948190263 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:32.500870 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-49fa16ca-b847-4aba-8068-8f4948190263 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:32.507207 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-49fa16ca-b847-4aba-8068-8f4948190263 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:32.507649 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-49fa16ca-b847-4aba-8068-8f4948190263 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:32.508419 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-49fa16ca-b847-4aba-8068-8f4948190263 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:32.508844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-49fa16ca-b847-4aba-8068-8f4948190263 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:32.651961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-49fa16ca-b847-4aba-8068-8f4948190263 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:32.660023 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-49fa16ca-b847-4aba-8068-8f4948190263 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.164059 Aug 30 07:48:32.660599 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 62/124] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:32 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:32.881346 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-89254ba0-b270-4272-9aed-0cf241371267 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:32.882253 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-89254ba0-b270-4272-9aed-0cf241371267 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:32.888780 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-89254ba0-b270-4272-9aed-0cf241371267 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:32.889215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-89254ba0-b270-4272-9aed-0cf241371267 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:32.889992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-89254ba0-b270-4272-9aed-0cf241371267 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:32.890453 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-89254ba0-b270-4272-9aed-0cf241371267 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:33.019122 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-89254ba0-b270-4272-9aed-0cf241371267 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:33.026964 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-89254ba0-b270-4272-9aed-0cf241371267 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.149825 Aug 30 07:48:33.027844 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 63/125] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:32 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:33.187668 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a24294c9-6d12-4263-b8fc-ee6fb1b00c32 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:33.189464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a24294c9-6d12-4263-b8fc-ee6fb1b00c32 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:33.195568 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a24294c9-6d12-4263-b8fc-ee6fb1b00c32 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:33.196014 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a24294c9-6d12-4263-b8fc-ee6fb1b00c32 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:33.197285 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a24294c9-6d12-4263-b8fc-ee6fb1b00c32 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:33.197791 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a24294c9-6d12-4263-b8fc-ee6fb1b00c32 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:33.342621 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a24294c9-6d12-4263-b8fc-ee6fb1b00c32 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:33.349970 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a24294c9-6d12-4263-b8fc-ee6fb1b00c32 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.165960 Aug 30 07:48:33.350794 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 63/126] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:33 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:33.422365 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1cffb32c-768a-46d1-929c-139c8233ae33 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:33.423092 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1cffb32c-768a-46d1-929c-139c8233ae33 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:33.428982 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1cffb32c-768a-46d1-929c-139c8233ae33 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:33.429520 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1cffb32c-768a-46d1-929c-139c8233ae33 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:33.430438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1cffb32c-768a-46d1-929c-139c8233ae33 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:33.430880 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1cffb32c-768a-46d1-929c-139c8233ae33 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:33.554588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1cffb32c-768a-46d1-929c-139c8233ae33 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:33.562815 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1cffb32c-768a-46d1-929c-139c8233ae33 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.152576 Aug 30 07:48:33.563400 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 64/127] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:33 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:33.679083 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-de54d022-9615-4f0d-8f87-71ddd28d1f07 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:33.679795 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-de54d022-9615-4f0d-8f87-71ddd28d1f07 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:33.686969 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de54d022-9615-4f0d-8f87-71ddd28d1f07 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:33.687434 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de54d022-9615-4f0d-8f87-71ddd28d1f07 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:33.688193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de54d022-9615-4f0d-8f87-71ddd28d1f07 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:33.688629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de54d022-9615-4f0d-8f87-71ddd28d1f07 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:33.832058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-de54d022-9615-4f0d-8f87-71ddd28d1f07 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:33.841644 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-de54d022-9615-4f0d-8f87-71ddd28d1f07 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.166954 Aug 30 07:48:33.842367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 64/128] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:33 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:34.044147 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6d46ab56-930d-4e3b-8303-39dcc539b3b4 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:34.044766 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6d46ab56-930d-4e3b-8303-39dcc539b3b4 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:34.050695 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6d46ab56-930d-4e3b-8303-39dcc539b3b4 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:34.051153 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6d46ab56-930d-4e3b-8303-39dcc539b3b4 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:34.051955 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6d46ab56-930d-4e3b-8303-39dcc539b3b4 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:34.052587 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6d46ab56-930d-4e3b-8303-39dcc539b3b4 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:34.176449 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6d46ab56-930d-4e3b-8303-39dcc539b3b4 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:34.185303 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6d46ab56-930d-4e3b-8303-39dcc539b3b4 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.145404 Aug 30 07:48:34.185886 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 65/129] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:34 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:34.366564 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c9388f08-ad8f-49a0-a4b7-6ee22af4d60b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:34.367151 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c9388f08-ad8f-49a0-a4b7-6ee22af4d60b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:34.373081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9388f08-ad8f-49a0-a4b7-6ee22af4d60b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:34.373529 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9388f08-ad8f-49a0-a4b7-6ee22af4d60b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:34.374331 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9388f08-ad8f-49a0-a4b7-6ee22af4d60b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:34.374809 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9388f08-ad8f-49a0-a4b7-6ee22af4d60b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:34.513816 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c9388f08-ad8f-49a0-a4b7-6ee22af4d60b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:34.521536 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c9388f08-ad8f-49a0-a4b7-6ee22af4d60b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.158490 Aug 30 07:48:34.522105 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 65/130] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:34 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:34.579784 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d9bbd9ef-3967-463b-a065-22a7fc975b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:34.580461 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d9bbd9ef-3967-463b-a065-22a7fc975b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:34.586056 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9bbd9ef-3967-463b-a065-22a7fc975b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:34.586530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9bbd9ef-3967-463b-a065-22a7fc975b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:34.587314 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9bbd9ef-3967-463b-a065-22a7fc975b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:34.588267 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9bbd9ef-3967-463b-a065-22a7fc975b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:34.719622 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d9bbd9ef-3967-463b-a065-22a7fc975b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:34.728021 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d9bbd9ef-3967-463b-a065-22a7fc975b52 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.151684 Aug 30 07:48:34.728954 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 66/131] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:34 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:34.860677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-092f5c06-d27e-44b8-9c34-c68433eb32b2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:34.861281 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-092f5c06-d27e-44b8-9c34-c68433eb32b2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:34.867346 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-092f5c06-d27e-44b8-9c34-c68433eb32b2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:34.867830 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-092f5c06-d27e-44b8-9c34-c68433eb32b2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:34.869051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-092f5c06-d27e-44b8-9c34-c68433eb32b2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:34.869685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-092f5c06-d27e-44b8-9c34-c68433eb32b2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:35.003772 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-092f5c06-d27e-44b8-9c34-c68433eb32b2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:35.012673 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-092f5c06-d27e-44b8-9c34-c68433eb32b2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.155723 Aug 30 07:48:35.013285 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 66/132] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:34 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:35.202234 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a1335d81-d1ba-41a6-9cf1-fe390c1706e9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:35.203339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a1335d81-d1ba-41a6-9cf1-fe390c1706e9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:35.209247 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a1335d81-d1ba-41a6-9cf1-fe390c1706e9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:35.209628 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a1335d81-d1ba-41a6-9cf1-fe390c1706e9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:35.210428 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a1335d81-d1ba-41a6-9cf1-fe390c1706e9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:35.210855 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a1335d81-d1ba-41a6-9cf1-fe390c1706e9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:35.356528 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a1335d81-d1ba-41a6-9cf1-fe390c1706e9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:35.363917 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a1335d81-d1ba-41a6-9cf1-fe390c1706e9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.165771 Aug 30 07:48:35.364680 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 67/133] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:35 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:35.539333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9cc81e68-3baa-4f79-a110-27837c035d31 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:35.540140 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9cc81e68-3baa-4f79-a110-27837c035d31 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:35.546853 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9cc81e68-3baa-4f79-a110-27837c035d31 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:35.547512 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9cc81e68-3baa-4f79-a110-27837c035d31 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:35.548464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9cc81e68-3baa-4f79-a110-27837c035d31 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:35.548968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9cc81e68-3baa-4f79-a110-27837c035d31 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:35.694871 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9cc81e68-3baa-4f79-a110-27837c035d31 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:35.703145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9cc81e68-3baa-4f79-a110-27837c035d31 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.167431 Aug 30 07:48:35.713579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 67/134] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:35 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:35.746117 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-682fd7d4-ba9c-4772-bed1-dbd3e868416d tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:35.746891 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-682fd7d4-ba9c-4772-bed1-dbd3e868416d tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:35.752722 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-682fd7d4-ba9c-4772-bed1-dbd3e868416d tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:35.753258 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-682fd7d4-ba9c-4772-bed1-dbd3e868416d tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:35.754376 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-682fd7d4-ba9c-4772-bed1-dbd3e868416d tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:35.754918 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-682fd7d4-ba9c-4772-bed1-dbd3e868416d tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:35.909392 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-682fd7d4-ba9c-4772-bed1-dbd3e868416d tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:35.926566 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-682fd7d4-ba9c-4772-bed1-dbd3e868416d tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.186007 Aug 30 07:48:35.928409 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 68/135] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:35 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:36.030483 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-89b37ef3-ee14-4f42-b678-c49a9f874396 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:36.031094 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-89b37ef3-ee14-4f42-b678-c49a9f874396 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:36.037223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89b37ef3-ee14-4f42-b678-c49a9f874396 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:36.038002 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89b37ef3-ee14-4f42-b678-c49a9f874396 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:36.038886 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89b37ef3-ee14-4f42-b678-c49a9f874396 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:36.039515 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89b37ef3-ee14-4f42-b678-c49a9f874396 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:36.220342 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-89b37ef3-ee14-4f42-b678-c49a9f874396 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:36.227827 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-89b37ef3-ee14-4f42-b678-c49a9f874396 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.201224 Aug 30 07:48:36.229136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 68/136] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:36 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:36.381397 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4674a670-1eb6-4c85-b8cf-7306a7a4c9fd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:36.382275 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4674a670-1eb6-4c85-b8cf-7306a7a4c9fd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:36.389068 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4674a670-1eb6-4c85-b8cf-7306a7a4c9fd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:36.389530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4674a670-1eb6-4c85-b8cf-7306a7a4c9fd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:36.390374 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4674a670-1eb6-4c85-b8cf-7306a7a4c9fd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:36.390806 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4674a670-1eb6-4c85-b8cf-7306a7a4c9fd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:36.519736 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4674a670-1eb6-4c85-b8cf-7306a7a4c9fd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:36.528323 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4674a670-1eb6-4c85-b8cf-7306a7a4c9fd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.150641 Aug 30 07:48:36.528932 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 69/137] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:36 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:36.720191 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-37431b5a-3217-4aa7-8775-e1c1e3933c36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:36.720844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-37431b5a-3217-4aa7-8775-e1c1e3933c36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:36.726903 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37431b5a-3217-4aa7-8775-e1c1e3933c36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:36.727289 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37431b5a-3217-4aa7-8775-e1c1e3933c36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:36.728631 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37431b5a-3217-4aa7-8775-e1c1e3933c36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:36.728940 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37431b5a-3217-4aa7-8775-e1c1e3933c36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:36.854320 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-37431b5a-3217-4aa7-8775-e1c1e3933c36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:36.861685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-37431b5a-3217-4aa7-8775-e1c1e3933c36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.145157 Aug 30 07:48:36.862296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 69/138] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:36 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:36.944817 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-70935fa5-76e1-4a8f-ad25-a03eca10e588 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:36.945431 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-70935fa5-76e1-4a8f-ad25-a03eca10e588 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:36.952654 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-70935fa5-76e1-4a8f-ad25-a03eca10e588 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:36.953176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-70935fa5-76e1-4a8f-ad25-a03eca10e588 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:36.953961 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-70935fa5-76e1-4a8f-ad25-a03eca10e588 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:36.954463 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-70935fa5-76e1-4a8f-ad25-a03eca10e588 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:37.084560 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-70935fa5-76e1-4a8f-ad25-a03eca10e588 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:37.092294 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-70935fa5-76e1-4a8f-ad25-a03eca10e588 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.151132 Aug 30 07:48:37.094352 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 70/139] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:36 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:37.246296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-26b7f5ce-d3ed-4864-a0cb-416e855deed1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:37.246823 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-26b7f5ce-d3ed-4864-a0cb-416e855deed1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:37.253063 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-26b7f5ce-d3ed-4864-a0cb-416e855deed1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:37.253503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-26b7f5ce-d3ed-4864-a0cb-416e855deed1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:37.254293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-26b7f5ce-d3ed-4864-a0cb-416e855deed1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:37.254728 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-26b7f5ce-d3ed-4864-a0cb-416e855deed1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:37.386342 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-26b7f5ce-d3ed-4864-a0cb-416e855deed1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:37.394719 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-26b7f5ce-d3ed-4864-a0cb-416e855deed1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.152834 Aug 30 07:48:37.395294 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 70/140] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:37 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:37.545166 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-37c85a18-ad57-48d6-8913-6e21efd51059 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:37.545699 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-37c85a18-ad57-48d6-8913-6e21efd51059 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:37.555036 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-37c85a18-ad57-48d6-8913-6e21efd51059 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:37.555493 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-37c85a18-ad57-48d6-8913-6e21efd51059 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:37.556719 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-37c85a18-ad57-48d6-8913-6e21efd51059 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:37.556838 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-37c85a18-ad57-48d6-8913-6e21efd51059 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:37.720752 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-37c85a18-ad57-48d6-8913-6e21efd51059 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:37.730011 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-37c85a18-ad57-48d6-8913-6e21efd51059 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.188605 Aug 30 07:48:37.730651 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 71/141] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:37 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:37.878789 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-de0e1b5b-880b-45e6-a8ae-93551017027e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:37.881097 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-de0e1b5b-880b-45e6-a8ae-93551017027e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:37.892663 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de0e1b5b-880b-45e6-a8ae-93551017027e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:37.893406 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de0e1b5b-880b-45e6-a8ae-93551017027e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:37.894813 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de0e1b5b-880b-45e6-a8ae-93551017027e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:37.896380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de0e1b5b-880b-45e6-a8ae-93551017027e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:38.094519 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-de0e1b5b-880b-45e6-a8ae-93551017027e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:38.108165 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-de0e1b5b-880b-45e6-a8ae-93551017027e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.232928 Aug 30 07:48:38.109170 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 71/142] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:37 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:38.120614 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1fa3dc0a-8754-4237-8e05-71be7e558b15 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:38.121234 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1fa3dc0a-8754-4237-8e05-71be7e558b15 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:38.127542 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1fa3dc0a-8754-4237-8e05-71be7e558b15 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:38.127990 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1fa3dc0a-8754-4237-8e05-71be7e558b15 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:38.128759 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1fa3dc0a-8754-4237-8e05-71be7e558b15 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:38.129193 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1fa3dc0a-8754-4237-8e05-71be7e558b15 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:38.323345 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1fa3dc0a-8754-4237-8e05-71be7e558b15 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:38.336204 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1fa3dc0a-8754-4237-8e05-71be7e558b15 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.228488 Aug 30 07:48:38.338084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 72/143] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:38 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:38.412537 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5007681a-5855-4695-89df-0728ca060422 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:38.414180 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5007681a-5855-4695-89df-0728ca060422 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:38.423627 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5007681a-5855-4695-89df-0728ca060422 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:38.424258 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5007681a-5855-4695-89df-0728ca060422 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:38.425351 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5007681a-5855-4695-89df-0728ca060422 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:38.426098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5007681a-5855-4695-89df-0728ca060422 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:38.612122 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5007681a-5855-4695-89df-0728ca060422 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:38.621264 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5007681a-5855-4695-89df-0728ca060422 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.212843 Aug 30 07:48:38.621847 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 72/144] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:38 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:38.748821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-adc8edfd-68aa-4f56-8393-871d25a37ee3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:38.749830 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-adc8edfd-68aa-4f56-8393-871d25a37ee3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:38.762811 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-adc8edfd-68aa-4f56-8393-871d25a37ee3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:38.765954 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-adc8edfd-68aa-4f56-8393-871d25a37ee3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:38.767064 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-adc8edfd-68aa-4f56-8393-871d25a37ee3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:38.767767 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-adc8edfd-68aa-4f56-8393-871d25a37ee3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:38.941080 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-adc8edfd-68aa-4f56-8393-871d25a37ee3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:38.953439 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-adc8edfd-68aa-4f56-8393-871d25a37ee3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.208970 Aug 30 07:48:38.954255 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 73/145] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:38 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:39.126201 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-aaa686bd-5ae8-4cb9-a657-0871cf6f2f0d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:39.126820 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-aaa686bd-5ae8-4cb9-a657-0871cf6f2f0d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:39.133908 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aaa686bd-5ae8-4cb9-a657-0871cf6f2f0d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:39.135800 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aaa686bd-5ae8-4cb9-a657-0871cf6f2f0d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:39.137572 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aaa686bd-5ae8-4cb9-a657-0871cf6f2f0d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:39.138139 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aaa686bd-5ae8-4cb9-a657-0871cf6f2f0d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:39.299997 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-aaa686bd-5ae8-4cb9-a657-0871cf6f2f0d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:39.309342 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-aaa686bd-5ae8-4cb9-a657-0871cf6f2f0d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.187303 Aug 30 07:48:39.319129 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 73/146] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:39 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:39.354610 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7f52b85a-ec19-47e5-8708-999d21f211e6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:39.355114 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7f52b85a-ec19-47e5-8708-999d21f211e6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:39.361197 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f52b85a-ec19-47e5-8708-999d21f211e6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:39.361640 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f52b85a-ec19-47e5-8708-999d21f211e6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:39.362437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f52b85a-ec19-47e5-8708-999d21f211e6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:39.362865 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f52b85a-ec19-47e5-8708-999d21f211e6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:39.511303 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7f52b85a-ec19-47e5-8708-999d21f211e6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:39.518927 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7f52b85a-ec19-47e5-8708-999d21f211e6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.168948 Aug 30 07:48:39.519507 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 74/147] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:39 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:39.638451 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8e58ff3a-1c7f-4b5e-b666-065ef6c38b83 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:39.639504 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8e58ff3a-1c7f-4b5e-b666-065ef6c38b83 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:39.646287 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8e58ff3a-1c7f-4b5e-b666-065ef6c38b83 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:39.647268 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8e58ff3a-1c7f-4b5e-b666-065ef6c38b83 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:39.648288 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8e58ff3a-1c7f-4b5e-b666-065ef6c38b83 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:39.648781 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8e58ff3a-1c7f-4b5e-b666-065ef6c38b83 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:39.794836 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8e58ff3a-1c7f-4b5e-b666-065ef6c38b83 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:39.802332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8e58ff3a-1c7f-4b5e-b666-065ef6c38b83 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.168122 Aug 30 07:48:39.802899 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 74/148] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:39 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:39.971065 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fcc8baa2-2c69-4897-a5bf-b33f635cdd56 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:39.971679 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fcc8baa2-2c69-4897-a5bf-b33f635cdd56 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:39.977376 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fcc8baa2-2c69-4897-a5bf-b33f635cdd56 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:39.978977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fcc8baa2-2c69-4897-a5bf-b33f635cdd56 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:39.979764 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fcc8baa2-2c69-4897-a5bf-b33f635cdd56 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:39.980192 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fcc8baa2-2c69-4897-a5bf-b33f635cdd56 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:40.128817 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-fcc8baa2-2c69-4897-a5bf-b33f635cdd56 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:40.137413 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fcc8baa2-2c69-4897-a5bf-b33f635cdd56 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.169878 Aug 30 07:48:40.137993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 75/149] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:39 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:40.328455 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-453b6240-1b98-42de-954a-7f0ce8d491de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:40.329746 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-453b6240-1b98-42de-954a-7f0ce8d491de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:40.335893 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-453b6240-1b98-42de-954a-7f0ce8d491de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:40.336338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-453b6240-1b98-42de-954a-7f0ce8d491de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:40.337651 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-453b6240-1b98-42de-954a-7f0ce8d491de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:40.338085 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-453b6240-1b98-42de-954a-7f0ce8d491de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:40.475255 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-453b6240-1b98-42de-954a-7f0ce8d491de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:40.483897 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-453b6240-1b98-42de-954a-7f0ce8d491de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.159055 Aug 30 07:48:40.484523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 75/150] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:40 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:40.536071 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-159d1451-6eb4-43ca-8e2c-b9f4c0c36e92 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:40.536709 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-159d1451-6eb4-43ca-8e2c-b9f4c0c36e92 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:40.545758 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-159d1451-6eb4-43ca-8e2c-b9f4c0c36e92 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:40.546220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-159d1451-6eb4-43ca-8e2c-b9f4c0c36e92 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:40.550012 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-159d1451-6eb4-43ca-8e2c-b9f4c0c36e92 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:40.550012 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-159d1451-6eb4-43ca-8e2c-b9f4c0c36e92 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:40.671233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-159d1451-6eb4-43ca-8e2c-b9f4c0c36e92 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:40.678485 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-159d1451-6eb4-43ca-8e2c-b9f4c0c36e92 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.146065 Aug 30 07:48:40.679100 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 76/151] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:40 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:40.819793 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ea45a754-529f-46a4-90bd-a60e5d4e939e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:40.820394 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ea45a754-529f-46a4-90bd-a60e5d4e939e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:40.826971 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea45a754-529f-46a4-90bd-a60e5d4e939e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:40.827413 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea45a754-529f-46a4-90bd-a60e5d4e939e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:40.828167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea45a754-529f-46a4-90bd-a60e5d4e939e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:40.828667 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea45a754-529f-46a4-90bd-a60e5d4e939e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:40.955177 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ea45a754-529f-46a4-90bd-a60e5d4e939e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:40.963080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ea45a754-529f-46a4-90bd-a60e5d4e939e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.146316 Aug 30 07:48:40.963663 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 76/152] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:40 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:41.154672 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7b31c3c4-7cb2-463f-b58a-6bf7778f6825 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:41.155287 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7b31c3c4-7cb2-463f-b58a-6bf7778f6825 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:41.161411 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7b31c3c4-7cb2-463f-b58a-6bf7778f6825 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:41.161862 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7b31c3c4-7cb2-463f-b58a-6bf7778f6825 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:41.162691 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7b31c3c4-7cb2-463f-b58a-6bf7778f6825 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:41.163130 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7b31c3c4-7cb2-463f-b58a-6bf7778f6825 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:41.297411 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7b31c3c4-7cb2-463f-b58a-6bf7778f6825 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:41.305305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7b31c3c4-7cb2-463f-b58a-6bf7778f6825 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.153534 Aug 30 07:48:41.305305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 77/153] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:41 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:41.501002 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-08e4c45e-0700-4747-aaf0-30b35b8368e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:41.501579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-08e4c45e-0700-4747-aaf0-30b35b8368e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:41.507573 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-08e4c45e-0700-4747-aaf0-30b35b8368e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:41.508015 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-08e4c45e-0700-4747-aaf0-30b35b8368e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:41.508765 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-08e4c45e-0700-4747-aaf0-30b35b8368e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:41.509511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-08e4c45e-0700-4747-aaf0-30b35b8368e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:41.638070 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-08e4c45e-0700-4747-aaf0-30b35b8368e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:41.649240 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-08e4c45e-0700-4747-aaf0-30b35b8368e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.151935 Aug 30 07:48:41.649867 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 77/154] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:41 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:41.695091 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3a914540-44d3-418a-b4a1-ff95b5aca228 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:41.696017 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3a914540-44d3-418a-b4a1-ff95b5aca228 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:41.702139 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3a914540-44d3-418a-b4a1-ff95b5aca228 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:41.702607 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3a914540-44d3-418a-b4a1-ff95b5aca228 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:41.703373 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3a914540-44d3-418a-b4a1-ff95b5aca228 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:41.703798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3a914540-44d3-418a-b4a1-ff95b5aca228 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:41.832252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3a914540-44d3-418a-b4a1-ff95b5aca228 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:41.840370 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3a914540-44d3-418a-b4a1-ff95b5aca228 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.149167 Aug 30 07:48:41.840929 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 78/155] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:41 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:41.980513 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-47ca9181-0009-425f-bff3-1a043f5c2e97 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:41.981155 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-47ca9181-0009-425f-bff3-1a043f5c2e97 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:41.986998 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-47ca9181-0009-425f-bff3-1a043f5c2e97 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:41.987446 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-47ca9181-0009-425f-bff3-1a043f5c2e97 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:41.988203 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-47ca9181-0009-425f-bff3-1a043f5c2e97 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:41.988631 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-47ca9181-0009-425f-bff3-1a043f5c2e97 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:42.112090 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-47ca9181-0009-425f-bff3-1a043f5c2e97 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:42.119958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-47ca9181-0009-425f-bff3-1a043f5c2e97 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.143719 Aug 30 07:48:42.120528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 78/156] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:41 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:42.322673 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-35ee77f8-2314-448e-bab1-f67deb74c610 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:42.323221 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-35ee77f8-2314-448e-bab1-f67deb74c610 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:42.328988 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-35ee77f8-2314-448e-bab1-f67deb74c610 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:42.329435 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-35ee77f8-2314-448e-bab1-f67deb74c610 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:42.330216 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-35ee77f8-2314-448e-bab1-f67deb74c610 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:42.330654 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-35ee77f8-2314-448e-bab1-f67deb74c610 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:42.456238 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-35ee77f8-2314-448e-bab1-f67deb74c610 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:42.464410 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-35ee77f8-2314-448e-bab1-f67deb74c610 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.146107 Aug 30 07:48:42.464996 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 79/157] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:42 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:42.666165 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8df2aedd-069e-4604-9da5-2bcae3fe4007 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:42.666777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8df2aedd-069e-4604-9da5-2bcae3fe4007 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:42.672778 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8df2aedd-069e-4604-9da5-2bcae3fe4007 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:42.673221 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8df2aedd-069e-4604-9da5-2bcae3fe4007 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:42.673978 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8df2aedd-069e-4604-9da5-2bcae3fe4007 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:42.674476 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8df2aedd-069e-4604-9da5-2bcae3fe4007 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:42.795209 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8df2aedd-069e-4604-9da5-2bcae3fe4007 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:42.802345 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8df2aedd-069e-4604-9da5-2bcae3fe4007 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.139978 Aug 30 07:48:42.802906 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 79/158] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:42 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:42.856480 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1cffc1d7-0112-494b-a2db-afc4fe3e9225 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:42.857079 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1cffc1d7-0112-494b-a2db-afc4fe3e9225 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:42.862940 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1cffc1d7-0112-494b-a2db-afc4fe3e9225 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:42.863384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1cffc1d7-0112-494b-a2db-afc4fe3e9225 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:42.864134 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1cffc1d7-0112-494b-a2db-afc4fe3e9225 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:42.864562 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1cffc1d7-0112-494b-a2db-afc4fe3e9225 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:42.987214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1cffc1d7-0112-494b-a2db-afc4fe3e9225 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:42.995435 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1cffc1d7-0112-494b-a2db-afc4fe3e9225 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.142523 Aug 30 07:48:42.995992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 80/159] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:42 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:43.137251 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9b36c40e-c6e0-4c01-99d8-97e27cea9519 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:43.137933 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9b36c40e-c6e0-4c01-99d8-97e27cea9519 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:43.144544 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b36c40e-c6e0-4c01-99d8-97e27cea9519 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:43.144982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b36c40e-c6e0-4c01-99d8-97e27cea9519 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:43.145756 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b36c40e-c6e0-4c01-99d8-97e27cea9519 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:43.146216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b36c40e-c6e0-4c01-99d8-97e27cea9519 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:43.269828 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9b36c40e-c6e0-4c01-99d8-97e27cea9519 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:43.277031 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9b36c40e-c6e0-4c01-99d8-97e27cea9519 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.143919 Aug 30 07:48:43.277578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 80/160] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:43 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:43.481506 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a1cf92ce-1694-40b5-947b-e5f5dd8a7c7b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:43.482050 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a1cf92ce-1694-40b5-947b-e5f5dd8a7c7b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:43.488140 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a1cf92ce-1694-40b5-947b-e5f5dd8a7c7b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:43.488582 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a1cf92ce-1694-40b5-947b-e5f5dd8a7c7b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:43.489341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a1cf92ce-1694-40b5-947b-e5f5dd8a7c7b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:43.489777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a1cf92ce-1694-40b5-947b-e5f5dd8a7c7b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:43.616715 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a1cf92ce-1694-40b5-947b-e5f5dd8a7c7b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:43.624006 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a1cf92ce-1694-40b5-947b-e5f5dd8a7c7b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.146985 Aug 30 07:48:43.624556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 81/161] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:43 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:43.819585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5b551752-3cef-4daa-bc60-976905d0c555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:43.820110 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5b551752-3cef-4daa-bc60-976905d0c555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:43.826810 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b551752-3cef-4daa-bc60-976905d0c555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:43.827352 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b551752-3cef-4daa-bc60-976905d0c555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:43.828172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b551752-3cef-4daa-bc60-976905d0c555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:43.828599 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b551752-3cef-4daa-bc60-976905d0c555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:43.950027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5b551752-3cef-4daa-bc60-976905d0c555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:43.958105 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5b551752-3cef-4daa-bc60-976905d0c555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.142119 Aug 30 07:48:43.958731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 81/162] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:43 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:44.012475 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c8442173-bdae-4dad-a228-514381ee176a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:44.013084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c8442173-bdae-4dad-a228-514381ee176a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:44.019305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c8442173-bdae-4dad-a228-514381ee176a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:44.019761 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c8442173-bdae-4dad-a228-514381ee176a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:44.020562 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c8442173-bdae-4dad-a228-514381ee176a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:44.021001 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c8442173-bdae-4dad-a228-514381ee176a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:44.152367 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c8442173-bdae-4dad-a228-514381ee176a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:44.159630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c8442173-bdae-4dad-a228-514381ee176a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.151288 Aug 30 07:48:44.160185 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 82/163] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:44 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:44.293464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2e4bf865-8d03-44d5-8ebc-f6f3b3047b22 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:44.294040 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2e4bf865-8d03-44d5-8ebc-f6f3b3047b22 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:44.299950 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e4bf865-8d03-44d5-8ebc-f6f3b3047b22 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:44.303217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e4bf865-8d03-44d5-8ebc-f6f3b3047b22 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:44.303217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e4bf865-8d03-44d5-8ebc-f6f3b3047b22 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:44.303217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e4bf865-8d03-44d5-8ebc-f6f3b3047b22 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:44.429584 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2e4bf865-8d03-44d5-8ebc-f6f3b3047b22 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:44.437672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2e4bf865-8d03-44d5-8ebc-f6f3b3047b22 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.148092 Aug 30 07:48:44.438254 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 82/164] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:44 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:44.640827 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8aa3c017-c038-42e5-9ebf-f7e5186814d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:44.641366 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8aa3c017-c038-42e5-9ebf-f7e5186814d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:44.647282 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8aa3c017-c038-42e5-9ebf-f7e5186814d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:44.647722 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8aa3c017-c038-42e5-9ebf-f7e5186814d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:44.648473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8aa3c017-c038-42e5-9ebf-f7e5186814d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:44.648898 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8aa3c017-c038-42e5-9ebf-f7e5186814d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:44.773446 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8aa3c017-c038-42e5-9ebf-f7e5186814d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:44.780601 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8aa3c017-c038-42e5-9ebf-f7e5186814d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.143580 Aug 30 07:48:44.781162 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 83/165] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:44 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:44.975746 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f96866d6-996a-458c-b6c7-f5daa3a3157d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:44.976354 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f96866d6-996a-458c-b6c7-f5daa3a3157d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:44.982781 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f96866d6-996a-458c-b6c7-f5daa3a3157d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:44.983231 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f96866d6-996a-458c-b6c7-f5daa3a3157d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:44.983996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f96866d6-996a-458c-b6c7-f5daa3a3157d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:44.984446 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f96866d6-996a-458c-b6c7-f5daa3a3157d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:45.113494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f96866d6-996a-458c-b6c7-f5daa3a3157d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:45.121277 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f96866d6-996a-458c-b6c7-f5daa3a3157d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.149045 Aug 30 07:48:45.121659 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 83/166] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:44 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:45.176831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f5dc3dba-4755-4b41-ba0e-41eaa9b8091f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:45.177384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f5dc3dba-4755-4b41-ba0e-41eaa9b8091f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:45.183630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5dc3dba-4755-4b41-ba0e-41eaa9b8091f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:45.184073 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5dc3dba-4755-4b41-ba0e-41eaa9b8091f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:45.184823 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5dc3dba-4755-4b41-ba0e-41eaa9b8091f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:45.185251 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5dc3dba-4755-4b41-ba0e-41eaa9b8091f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:45.317722 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f5dc3dba-4755-4b41-ba0e-41eaa9b8091f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:45.325793 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f5dc3dba-4755-4b41-ba0e-41eaa9b8091f tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.153265 Aug 30 07:48:45.326401 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 84/167] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:45 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:45.459580 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-84e31355-e0e0-4e62-bb7d-5789dcd48a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:45.459580 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-84e31355-e0e0-4e62-bb7d-5789dcd48a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:45.463091 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-84e31355-e0e0-4e62-bb7d-5789dcd48a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:45.463585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-84e31355-e0e0-4e62-bb7d-5789dcd48a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:45.464633 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-84e31355-e0e0-4e62-bb7d-5789dcd48a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:45.465216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-84e31355-e0e0-4e62-bb7d-5789dcd48a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:45.595773 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-84e31355-e0e0-4e62-bb7d-5789dcd48a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:45.603127 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-84e31355-e0e0-4e62-bb7d-5789dcd48a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.153256 Aug 30 07:48:45.603704 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 84/168] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:45 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:45.798121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5cab0b03-fcd0-4f52-a296-1601d2809ae6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:45.798779 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5cab0b03-fcd0-4f52-a296-1601d2809ae6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:45.804898 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cab0b03-fcd0-4f52-a296-1601d2809ae6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:45.805346 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cab0b03-fcd0-4f52-a296-1601d2809ae6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:45.806798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cab0b03-fcd0-4f52-a296-1601d2809ae6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:45.807321 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cab0b03-fcd0-4f52-a296-1601d2809ae6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:45.932060 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5cab0b03-fcd0-4f52-a296-1601d2809ae6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:45.939183 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5cab0b03-fcd0-4f52-a296-1601d2809ae6 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.145169 Aug 30 07:48:45.939753 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 85/169] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:45 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:46.138182 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-92a0557e-a80f-47c1-94b0-bbc46ce84bc4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:46.138832 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-92a0557e-a80f-47c1-94b0-bbc46ce84bc4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:46.144604 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-92a0557e-a80f-47c1-94b0-bbc46ce84bc4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:46.145051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-92a0557e-a80f-47c1-94b0-bbc46ce84bc4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:46.145824 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-92a0557e-a80f-47c1-94b0-bbc46ce84bc4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:46.146281 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-92a0557e-a80f-47c1-94b0-bbc46ce84bc4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:46.291675 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-92a0557e-a80f-47c1-94b0-bbc46ce84bc4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:46.298935 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-92a0557e-a80f-47c1-94b0-bbc46ce84bc4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.164485 Aug 30 07:48:46.299503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 85/170] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:46 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:46.344191 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-23e4ecc3-43c0-4b66-a61b-91910835a029 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:46.345089 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-23e4ecc3-43c0-4b66-a61b-91910835a029 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:46.351424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-23e4ecc3-43c0-4b66-a61b-91910835a029 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:46.351935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-23e4ecc3-43c0-4b66-a61b-91910835a029 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:46.353372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-23e4ecc3-43c0-4b66-a61b-91910835a029 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:46.353864 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-23e4ecc3-43c0-4b66-a61b-91910835a029 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:46.484436 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-23e4ecc3-43c0-4b66-a61b-91910835a029 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:46.492815 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-23e4ecc3-43c0-4b66-a61b-91910835a029 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.152583 Aug 30 07:48:46.502136 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 86/171] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:46 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:46.622404 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-38c695d3-cb8c-431f-8165-a856d007473a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:46.622404 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-38c695d3-cb8c-431f-8165-a856d007473a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:46.627650 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-38c695d3-cb8c-431f-8165-a856d007473a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:46.628100 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-38c695d3-cb8c-431f-8165-a856d007473a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:46.628865 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-38c695d3-cb8c-431f-8165-a856d007473a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:46.629297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-38c695d3-cb8c-431f-8165-a856d007473a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:46.772494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-38c695d3-cb8c-431f-8165-a856d007473a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:46.781136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-38c695d3-cb8c-431f-8165-a856d007473a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.165221 Aug 30 07:48:46.781770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 86/172] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:46 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:46.960800 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bb1efb50-8802-4a9c-a6d9-670c5d1a28f3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:46.960800 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bb1efb50-8802-4a9c-a6d9-670c5d1a28f3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:46.966295 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bb1efb50-8802-4a9c-a6d9-670c5d1a28f3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:46.966885 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bb1efb50-8802-4a9c-a6d9-670c5d1a28f3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:46.967695 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bb1efb50-8802-4a9c-a6d9-670c5d1a28f3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:46.968276 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bb1efb50-8802-4a9c-a6d9-670c5d1a28f3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:47.158079 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-bb1efb50-8802-4a9c-a6d9-670c5d1a28f3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:47.169947 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bb1efb50-8802-4a9c-a6d9-670c5d1a28f3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.214170 Aug 30 07:48:47.169947 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 87/173] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:46 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:47.321629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-23369041-f924-454f-a466-9df3f79e12ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:47.323343 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-23369041-f924-454f-a466-9df3f79e12ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:47.330018 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-23369041-f924-454f-a466-9df3f79e12ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:47.330696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-23369041-f924-454f-a466-9df3f79e12ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:47.331876 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-23369041-f924-454f-a466-9df3f79e12ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:47.332492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-23369041-f924-454f-a466-9df3f79e12ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:47.505059 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-23369041-f924-454f-a466-9df3f79e12ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:47.511651 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6cad539a-c982-4ae3-82f6-d1ec81e6135a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:47.512433 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6cad539a-c982-4ae3-82f6-d1ec81e6135a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:47.521734 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6cad539a-c982-4ae3-82f6-d1ec81e6135a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:47.522503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-23369041-f924-454f-a466-9df3f79e12ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.204826 Aug 30 07:48:47.523000 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6cad539a-c982-4ae3-82f6-d1ec81e6135a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:47.523122 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 87/174] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:47 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:47.535563 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6cad539a-c982-4ae3-82f6-d1ec81e6135a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:47.536055 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6cad539a-c982-4ae3-82f6-d1ec81e6135a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:47.681730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6cad539a-c982-4ae3-82f6-d1ec81e6135a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:47.690287 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6cad539a-c982-4ae3-82f6-d1ec81e6135a tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.184989 Aug 30 07:48:47.691273 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 88/175] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:47 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:47.798905 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-464be9cb-0da6-4b17-bebf-f35645e2f020 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:47.799515 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-464be9cb-0da6-4b17-bebf-f35645e2f020 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:47.806546 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-464be9cb-0da6-4b17-bebf-f35645e2f020 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:47.806996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-464be9cb-0da6-4b17-bebf-f35645e2f020 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:47.807772 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-464be9cb-0da6-4b17-bebf-f35645e2f020 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:47.808193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-464be9cb-0da6-4b17-bebf-f35645e2f020 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:47.955935 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-464be9cb-0da6-4b17-bebf-f35645e2f020 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:47.966508 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-464be9cb-0da6-4b17-bebf-f35645e2f020 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.171656 Aug 30 07:48:47.977154 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 88/176] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:47 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:48.159788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-41591e80-be06-4a36-97ce-29dbbbe7307c req-cf29e3a6-a057-413a-9066-f3d1a4d22fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4967d79f-d77e-494e-913b-b11b09a5dee4", "name": "network-vif-plugged", "status": "completed", "tag": "6775eff3-812a-4ed1-8de8-36fd5d098c28"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:48.162892 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:48:48.162892 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:48:48.171139 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-41591e80-be06-4a36-97ce-29dbbbe7307c req-cf29e3a6-a057-413a-9066-f3d1a4d22fc9 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:48.171586 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-41591e80-be06-4a36-97ce-29dbbbe7307c req-cf29e3a6-a057-413a-9066-f3d1a4d22fc9 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:48.184293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ad90cea3-5e7c-434b-9c5e-a9496ec04502 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:48.184767 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ad90cea3-5e7c-434b-9c5e-a9496ec04502 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:48.193329 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ad90cea3-5e7c-434b-9c5e-a9496ec04502 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:48.193788 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ad90cea3-5e7c-434b-9c5e-a9496ec04502 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:48.195063 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ad90cea3-5e7c-434b-9c5e-a9496ec04502 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:48.197547 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-41591e80-be06-4a36-97ce-29dbbbe7307c req-cf29e3a6-a057-413a-9066-f3d1a4d22fc9 service nova] Creating event network-vif-plugged:6775eff3-812a-4ed1-8de8-36fd5d098c28 for instance 4967d79f-d77e-494e-913b-b11b09a5dee4 on hv-cinder-80619 Aug 30 07:48:48.198188 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ad90cea3-5e7c-434b-9c5e-a9496ec04502 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:48.207571 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-41591e80-be06-4a36-97ce-29dbbbe7307c req-cf29e3a6-a057-413a-9066-f3d1a4d22fc9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124262 Aug 30 07:48:48.208399 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 89/177] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:48:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:48:48.517005 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ad90cea3-5e7c-434b-9c5e-a9496ec04502 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:48.527864 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ad90cea3-5e7c-434b-9c5e-a9496ec04502 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.345870 Aug 30 07:48:48.528664 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 89/178] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:48 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:48.543817 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2c51b8fb-945c-452d-b8d3-70d311a23148 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:48.548670 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2c51b8fb-945c-452d-b8d3-70d311a23148 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:48.562484 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c51b8fb-945c-452d-b8d3-70d311a23148 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:48.566258 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c51b8fb-945c-452d-b8d3-70d311a23148 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:48.568584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c51b8fb-945c-452d-b8d3-70d311a23148 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:48.570839 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c51b8fb-945c-452d-b8d3-70d311a23148 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:48.709813 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0b37d89d-27a5-46b3-a199-f0165fd7a18e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:48.710766 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0b37d89d-27a5-46b3-a199-f0165fd7a18e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:48.723833 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0b37d89d-27a5-46b3-a199-f0165fd7a18e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:48.724549 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0b37d89d-27a5-46b3-a199-f0165fd7a18e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:48.725562 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0b37d89d-27a5-46b3-a199-f0165fd7a18e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:48.726268 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0b37d89d-27a5-46b3-a199-f0165fd7a18e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:48.793840 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2c51b8fb-945c-452d-b8d3-70d311a23148 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:48.803084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2c51b8fb-945c-452d-b8d3-70d311a23148 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.265907 Aug 30 07:48:48.803699 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 90/179] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:48 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:48.981088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0b37d89d-27a5-46b3-a199-f0165fd7a18e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:48.985936 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2a287657-36dd-4f01-932a-852c2fbd252d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:48.986799 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2a287657-36dd-4f01-932a-852c2fbd252d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:48.990672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0b37d89d-27a5-46b3-a199-f0165fd7a18e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.285952 Aug 30 07:48:48.995192 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2a287657-36dd-4f01-932a-852c2fbd252d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:48.995622 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2a287657-36dd-4f01-932a-852c2fbd252d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:48.998246 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 90/180] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:48 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:49.000095 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2a287657-36dd-4f01-932a-852c2fbd252d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:49.000548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2a287657-36dd-4f01-932a-852c2fbd252d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:49.233745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2a287657-36dd-4f01-932a-852c2fbd252d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:49.260541 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2a287657-36dd-4f01-932a-852c2fbd252d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.280266 Aug 30 07:48:49.261150 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 91/181] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:48 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:49.545247 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-44c0efec-d43e-497c-a72f-9b58acdeb0c2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:49.545857 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-44c0efec-d43e-497c-a72f-9b58acdeb0c2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:49.552205 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44c0efec-d43e-497c-a72f-9b58acdeb0c2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:49.552902 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44c0efec-d43e-497c-a72f-9b58acdeb0c2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:49.553865 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44c0efec-d43e-497c-a72f-9b58acdeb0c2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:49.554507 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44c0efec-d43e-497c-a72f-9b58acdeb0c2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:49.744228 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-44c0efec-d43e-497c-a72f-9b58acdeb0c2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:49.753223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-44c0efec-d43e-497c-a72f-9b58acdeb0c2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.211520 Aug 30 07:48:49.754046 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 91/182] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:49 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:49.824345 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-85447bf9-5924-41f1-a358-0083c14f5907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:49.825434 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-85447bf9-5924-41f1-a358-0083c14f5907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:49.838877 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-85447bf9-5924-41f1-a358-0083c14f5907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:49.839577 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-85447bf9-5924-41f1-a358-0083c14f5907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:49.840598 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-85447bf9-5924-41f1-a358-0083c14f5907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:49.841340 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-85447bf9-5924-41f1-a358-0083c14f5907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:49.986902 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-85447bf9-5924-41f1-a358-0083c14f5907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:49.994579 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-85447bf9-5924-41f1-a358-0083c14f5907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.177229 Aug 30 07:48:49.995162 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 92/183] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:49 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:50.013279 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4a62d363-743a-442e-bbe1-f3b555dc4c53 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:50.014247 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4a62d363-743a-442e-bbe1-f3b555dc4c53 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:50.020417 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a62d363-743a-442e-bbe1-f3b555dc4c53 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:50.020861 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a62d363-743a-442e-bbe1-f3b555dc4c53 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:50.021618 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a62d363-743a-442e-bbe1-f3b555dc4c53 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:50.022223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a62d363-743a-442e-bbe1-f3b555dc4c53 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:50.151394 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4a62d363-743a-442e-bbe1-f3b555dc4c53 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:50.158782 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4a62d363-743a-442e-bbe1-f3b555dc4c53 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.149966 Aug 30 07:48:50.159369 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 92/184] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:50 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:50.229922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-e8f7f04b-b516-432d-b8cd-77f451eadd7a req-a2f91067-2cc2-4d8f-a888-334481e0564a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab74e53e-3def-4d56-a5a3-9bdaae91e894", "name": "network-vif-plugged", "status": "completed", "tag": "7df2dfe2-84f3-44d6-9b60-1cece886854d"}, {"server_uuid": "95fc5a1e-6b49-475e-85ec-93d172a0d3e2", "name": "network-vif-plugged", "status": "completed", "tag": "ae18f657-8bf1-4e50-b57d-7f58cd1f4360"}, {"server_uuid": "bf7e7530-d91c-4112-98e3-e0297020dfb6", "name": "network-vif-plugged", "status": "completed", "tag": "708e585c-b3c8-47c5-afdf-a68c26eb49ca"}, {"server_uuid": "63042c8c-43ca-4d02-8ef2-07a08833cdf1", "name": "network-vif-plugged", "status": "completed", "tag": "03f5aee7-d6fd-4ea0-b19a-d088da242d0e"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:50.234890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:48:50.234890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:48:50.244942 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-e8f7f04b-b516-432d-b8cd-77f451eadd7a req-a2f91067-2cc2-4d8f-a888-334481e0564a service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:50.245758 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-e8f7f04b-b516-432d-b8cd-77f451eadd7a req-a2f91067-2cc2-4d8f-a888-334481e0564a service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:50.276627 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8fa012a2-e48d-4141-aef1-98a751fce0f7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:50.277691 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8fa012a2-e48d-4141-aef1-98a751fce0f7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:50.288976 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8fa012a2-e48d-4141-aef1-98a751fce0f7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:50.289799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8fa012a2-e48d-4141-aef1-98a751fce0f7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:50.290835 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8fa012a2-e48d-4141-aef1-98a751fce0f7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:50.291483 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8fa012a2-e48d-4141-aef1-98a751fce0f7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:50.295999 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-e8f7f04b-b516-432d-b8cd-77f451eadd7a req-a2f91067-2cc2-4d8f-a888-334481e0564a service nova] Creating event network-vif-plugged:7df2dfe2-84f3-44d6-9b60-1cece886854d for instance ab74e53e-3def-4d56-a5a3-9bdaae91e894 on hv-cinder-80619 Aug 30 07:48:50.297789 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-e8f7f04b-b516-432d-b8cd-77f451eadd7a req-a2f91067-2cc2-4d8f-a888-334481e0564a service nova] Creating event network-vif-plugged:ae18f657-8bf1-4e50-b57d-7f58cd1f4360 for instance 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 on hv-cinder-80619 Aug 30 07:48:50.298419 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-e8f7f04b-b516-432d-b8cd-77f451eadd7a req-a2f91067-2cc2-4d8f-a888-334481e0564a service nova] Creating event network-vif-plugged:708e585c-b3c8-47c5-afdf-a68c26eb49ca for instance bf7e7530-d91c-4112-98e3-e0297020dfb6 on hv-cinder-80619 Aug 30 07:48:50.299727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-e8f7f04b-b516-432d-b8cd-77f451eadd7a req-a2f91067-2cc2-4d8f-a888-334481e0564a service nova] Creating event network-vif-plugged:03f5aee7-d6fd-4ea0-b19a-d088da242d0e for instance 63042c8c-43ca-4d02-8ef2-07a08833cdf1 on hv-cinder-80619 Aug 30 07:48:50.321607 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-e8f7f04b-b516-432d-b8cd-77f451eadd7a req-a2f91067-2cc2-4d8f-a888-334481e0564a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.095155 Aug 30 07:48:50.325503 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 93/185] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:48:50 2021] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:48:50.530783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8fa012a2-e48d-4141-aef1-98a751fce0f7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:50.541382 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8fa012a2-e48d-4141-aef1-98a751fce0f7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.266785 Aug 30 07:48:50.541988 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 93/186] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:50 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:50.774693 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d2f924b3-3a0e-4bff-a5d7-668897bb34ce tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:50.776191 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d2f924b3-3a0e-4bff-a5d7-668897bb34ce tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:50.786302 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d2f924b3-3a0e-4bff-a5d7-668897bb34ce tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:50.786831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d2f924b3-3a0e-4bff-a5d7-668897bb34ce tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:50.788412 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d2f924b3-3a0e-4bff-a5d7-668897bb34ce tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:50.788846 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d2f924b3-3a0e-4bff-a5d7-668897bb34ce tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:51.016750 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-067c3317-cbc8-4a9d-8bfe-0f18eb9f7ee9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:51.016750 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-067c3317-cbc8-4a9d-8bfe-0f18eb9f7ee9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:51.045172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-067c3317-cbc8-4a9d-8bfe-0f18eb9f7ee9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:51.045620 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-067c3317-cbc8-4a9d-8bfe-0f18eb9f7ee9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:51.046737 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-067c3317-cbc8-4a9d-8bfe-0f18eb9f7ee9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:51.047170 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-067c3317-cbc8-4a9d-8bfe-0f18eb9f7ee9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:51.262371 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d2f924b3-3a0e-4bff-a5d7-668897bb34ce tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:51.270774 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d2f924b3-3a0e-4bff-a5d7-668897bb34ce tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1318 microversion: 2.1 time: 0.502644 Aug 30 07:48:51.286806 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 94/187] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:50 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:51.291940 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4bda76b4-402b-4b6e-bd31-eb2f25084ec6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:51.294980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4bda76b4-402b-4b6e-bd31-eb2f25084ec6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:51.306344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4bda76b4-402b-4b6e-bd31-eb2f25084ec6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:51.307836 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4bda76b4-402b-4b6e-bd31-eb2f25084ec6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:51.309444 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4bda76b4-402b-4b6e-bd31-eb2f25084ec6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:51.310380 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4bda76b4-402b-4b6e-bd31-eb2f25084ec6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:51.313353 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-067c3317-cbc8-4a9d-8bfe-0f18eb9f7ee9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:51.334620 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-067c3317-cbc8-4a9d-8bfe-0f18eb9f7ee9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.324204 Aug 30 07:48:51.338541 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 94/188] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:51 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:51.539165 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4bda76b4-402b-4b6e-bd31-eb2f25084ec6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:51.547001 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4bda76b4-402b-4b6e-bd31-eb2f25084ec6 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.258672 Aug 30 07:48:51.551602 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 95/189] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:51 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:51.560058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-42c65d38-bb64-425a-b5b5-48bef8beb2fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:51.561154 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-42c65d38-bb64-425a-b5b5-48bef8beb2fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:51.570289 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-42c65d38-bb64-425a-b5b5-48bef8beb2fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:51.575283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-42c65d38-bb64-425a-b5b5-48bef8beb2fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:51.576196 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-42c65d38-bb64-425a-b5b5-48bef8beb2fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:51.576645 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-42c65d38-bb64-425a-b5b5-48bef8beb2fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:51.825858 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-42c65d38-bb64-425a-b5b5-48bef8beb2fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:51.833249 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-42c65d38-bb64-425a-b5b5-48bef8beb2fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.278307 Aug 30 07:48:51.833825 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 95/190] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:51 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:52.294935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-46199c0e-5060-4c2b-9a08-e326810e9cab tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:52.296267 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-46199c0e-5060-4c2b-9a08-e326810e9cab tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:52.303791 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46199c0e-5060-4c2b-9a08-e326810e9cab tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:52.304370 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46199c0e-5060-4c2b-9a08-e326810e9cab tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:52.306653 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46199c0e-5060-4c2b-9a08-e326810e9cab tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:52.307274 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46199c0e-5060-4c2b-9a08-e326810e9cab tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:52.355930 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b8fe9fbf-a10a-4b33-98d0-31a5b2358584 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:52.358599 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b8fe9fbf-a10a-4b33-98d0-31a5b2358584 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:52.369639 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8fe9fbf-a10a-4b33-98d0-31a5b2358584 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:52.371724 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8fe9fbf-a10a-4b33-98d0-31a5b2358584 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:52.373671 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8fe9fbf-a10a-4b33-98d0-31a5b2358584 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:52.374203 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8fe9fbf-a10a-4b33-98d0-31a5b2358584 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:52.492292 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-46199c0e-5060-4c2b-9a08-e326810e9cab tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:52.508355 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-46199c0e-5060-4c2b-9a08-e326810e9cab tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1508 microversion: 2.1 time: 0.217430 Aug 30 07:48:52.519986 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 96/191] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:52 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:52.568158 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cd7e2fd5-7ed8-4b7e-9c52-1765f7be2949 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:52.568774 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-cd7e2fd5-7ed8-4b7e-9c52-1765f7be2949 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:52.575514 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cd7e2fd5-7ed8-4b7e-9c52-1765f7be2949 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:52.576378 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cd7e2fd5-7ed8-4b7e-9c52-1765f7be2949 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:52.577298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cd7e2fd5-7ed8-4b7e-9c52-1765f7be2949 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:52.578347 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cd7e2fd5-7ed8-4b7e-9c52-1765f7be2949 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:52.623065 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b8fe9fbf-a10a-4b33-98d0-31a5b2358584 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:52.645385 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b8fe9fbf-a10a-4b33-98d0-31a5b2358584 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1362 microversion: 2.1 time: 0.294446 Aug 30 07:48:52.650412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 96/192] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:52 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:52.740764 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-cd7e2fd5-7ed8-4b7e-9c52-1765f7be2949 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:52.749762 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-cd7e2fd5-7ed8-4b7e-9c52-1765f7be2949 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.185302 Aug 30 07:48:52.750563 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 97/193] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:52 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:48:52.858857 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-79399ef7-379e-42fb-9253-a614cbc415bf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:52.860326 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-79399ef7-379e-42fb-9253-a614cbc415bf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:52.869060 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-79399ef7-379e-42fb-9253-a614cbc415bf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:52.870220 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-79399ef7-379e-42fb-9253-a614cbc415bf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:52.871452 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-79399ef7-379e-42fb-9253-a614cbc415bf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:52.872177 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-79399ef7-379e-42fb-9253-a614cbc415bf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:53.067850 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-79399ef7-379e-42fb-9253-a614cbc415bf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:53.076611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-79399ef7-379e-42fb-9253-a614cbc415bf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1321 microversion: 2.1 time: 0.224295 Aug 30 07:48:53.085647 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 97/194] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:52 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:53.668938 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5efba2c7-42a9-4974-9fc0-1703378acef5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:53.670653 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5efba2c7-42a9-4974-9fc0-1703378acef5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:53.677383 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5efba2c7-42a9-4974-9fc0-1703378acef5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:53.678637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5efba2c7-42a9-4974-9fc0-1703378acef5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:53.680096 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5efba2c7-42a9-4974-9fc0-1703378acef5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:53.681152 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5efba2c7-42a9-4974-9fc0-1703378acef5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:53.767643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a9e9fef9-3650-49e9-ade0-b9ba48fff44e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:53.768959 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a9e9fef9-3650-49e9-ade0-b9ba48fff44e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:53.780389 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a9e9fef9-3650-49e9-ade0-b9ba48fff44e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:53.781106 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a9e9fef9-3650-49e9-ade0-b9ba48fff44e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:53.782131 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a9e9fef9-3650-49e9-ade0-b9ba48fff44e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:53.782949 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a9e9fef9-3650-49e9-ade0-b9ba48fff44e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:53.870744 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5efba2c7-42a9-4974-9fc0-1703378acef5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:53.879360 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5efba2c7-42a9-4974-9fc0-1703378acef5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1547 microversion: 2.1 time: 0.216381 Aug 30 07:48:53.880470 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 98/195] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:53 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1547 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:53.901462 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-de6e5eaa-9495-40ea-8309-e2a60aa9cff3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:53.902711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-de6e5eaa-9495-40ea-8309-e2a60aa9cff3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:53.909344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de6e5eaa-9495-40ea-8309-e2a60aa9cff3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:53.910141 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de6e5eaa-9495-40ea-8309-e2a60aa9cff3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:53.911209 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de6e5eaa-9495-40ea-8309-e2a60aa9cff3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:53.911868 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de6e5eaa-9495-40ea-8309-e2a60aa9cff3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:54.004942 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a9e9fef9-3650-49e9-ade0-b9ba48fff44e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:54.020447 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a9e9fef9-3650-49e9-ade0-b9ba48fff44e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1314 microversion: 2.1 time: 0.257083 Aug 30 07:48:54.026448 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 98/196] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:53 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:54.078168 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-de6e5eaa-9495-40ea-8309-e2a60aa9cff3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180378 Aug 30 07:48:54.078760 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 99/197] 10.222.0.73 () {58 vars in 1275 bytes} [Mon Aug 30 07:48:53 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:48:54.094660 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c2dd29d8-6787-4303-86c8-fe85947c6bfc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:54.095615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c2dd29d8-6787-4303-86c8-fe85947c6bfc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:54.104137 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2dd29d8-6787-4303-86c8-fe85947c6bfc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:54.106668 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2dd29d8-6787-4303-86c8-fe85947c6bfc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:54.108374 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2dd29d8-6787-4303-86c8-fe85947c6bfc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:54.109082 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2dd29d8-6787-4303-86c8-fe85947c6bfc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:54.301576 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-af3224c8-32b7-4695-a1cd-b4d0c74084f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfafd178-bc3b-4ef2-9edb-70419a45d8fb"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:54.303251 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-af3224c8-32b7-4695-a1cd-b4d0c74084f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:54.316694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-af3224c8-32b7-4695-a1cd-b4d0c74084f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:54.317150 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-af3224c8-32b7-4695-a1cd-b4d0c74084f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:54.317925 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-af3224c8-32b7-4695-a1cd-b4d0c74084f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:54.318384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-af3224c8-32b7-4695-a1cd-b4d0c74084f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:54.737892 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c2dd29d8-6787-4303-86c8-fe85947c6bfc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:54.749445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c2dd29d8-6787-4303-86c8-fe85947c6bfc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1516 microversion: 2.1 time: 0.657092 Aug 30 07:48:54.751181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 99/198] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:54 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1516 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:54.768356 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-82c8ca73-828a-43c5-9214-2583a40a3f11 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:54.770683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-82c8ca73-828a-43c5-9214-2583a40a3f11 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:54.777678 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-82c8ca73-828a-43c5-9214-2583a40a3f11 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:54.782885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-82c8ca73-828a-43c5-9214-2583a40a3f11 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:54.783861 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-82c8ca73-828a-43c5-9214-2583a40a3f11 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:54.785810 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-82c8ca73-828a-43c5-9214-2583a40a3f11 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:54.998237 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-82c8ca73-828a-43c5-9214-2583a40a3f11 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lazy-loading 'flavor' on Instance uuid ab74e53e-3def-4d56-a5a3-9bdaae91e894 {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:48:55.327662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-82c8ca73-828a-43c5-9214-2583a40a3f11 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "POST /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894/action" status: 200 len: 32 microversion: 2.1 time: 0.562756 Aug 30 07:48:55.329174 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 100/199] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:48:54 2021] POST /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894/action => generated 32 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 07:48:55.335300 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d1613ffa-b967-403b-b18c-15c6605290ae tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:55.336585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d1613ffa-b967-403b-b18c-15c6605290ae tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:55.350581 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d1613ffa-b967-403b-b18c-15c6605290ae tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:55.351286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d1613ffa-b967-403b-b18c-15c6605290ae tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:55.352626 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d1613ffa-b967-403b-b18c-15c6605290ae tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:55.353778 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d1613ffa-b967-403b-b18c-15c6605290ae tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:55.416153 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-af3224c8-32b7-4695-a1cd-b4d0c74084f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "POST /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.115964 Aug 30 07:48:55.419992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 100/200] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:48:54 2021] POST /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments => generated 194 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:48:55.447981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ef67a40b-6b25-4869-87b1-a61f87ec1780 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:55.454414 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ef67a40b-6b25-4869-87b1-a61f87ec1780 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:55.477005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef67a40b-6b25-4869-87b1-a61f87ec1780 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:55.477005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef67a40b-6b25-4869-87b1-a61f87ec1780 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:55.478781 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef67a40b-6b25-4869-87b1-a61f87ec1780 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:55.479602 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef67a40b-6b25-4869-87b1-a61f87ec1780 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:55.714601 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d1613ffa-b967-403b-b18c-15c6605290ae tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:55.725402 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d1613ffa-b967-403b-b18c-15c6605290ae tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1500 microversion: 2.1 time: 0.394608 Aug 30 07:48:55.726362 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 101/201] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:55 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1500 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:55.834836 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ef67a40b-6b25-4869-87b1-a61f87ec1780 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:55.857507 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ef67a40b-6b25-4869-87b1-a61f87ec1780 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.433687 Aug 30 07:48:55.859767 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 101/202] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:55 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:56.594166 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-aec8760d-a171-4048-8203-e66f79367fc8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:56.595152 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-aec8760d-a171-4048-8203-e66f79367fc8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:56.603822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aec8760d-a171-4048-8203-e66f79367fc8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:56.604265 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aec8760d-a171-4048-8203-e66f79367fc8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:56.605054 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aec8760d-a171-4048-8203-e66f79367fc8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:56.605488 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aec8760d-a171-4048-8203-e66f79367fc8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:56.615674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-2a727d4e-5d0d-4002-b4fa-8f6f9e944127 req-5b9303ec-3cb2-4a75-b4b2-bed91a435707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63042c8c-43ca-4d02-8ef2-07a08833cdf1", "tag": "03f5aee7-d6fd-4ea0-b19a-d088da242d0e"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:56.621159 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:48:56.621159 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:48:56.649788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-2a727d4e-5d0d-4002-b4fa-8f6f9e944127 req-5b9303ec-3cb2-4a75-b4b2-bed91a435707 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:56.650261 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-2a727d4e-5d0d-4002-b4fa-8f6f9e944127 req-5b9303ec-3cb2-4a75-b4b2-bed91a435707 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:56.684538 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-2a727d4e-5d0d-4002-b4fa-8f6f9e944127 req-5b9303ec-3cb2-4a75-b4b2-bed91a435707 service nova] Creating event network-changed:03f5aee7-d6fd-4ea0-b19a-d088da242d0e for instance 63042c8c-43ca-4d02-8ef2-07a08833cdf1 on hv-cinder-80619 Aug 30 07:48:56.697885 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-2a727d4e-5d0d-4002-b4fa-8f6f9e944127 req-5b9303ec-3cb2-4a75-b4b2-bed91a435707 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086199 Aug 30 07:48:56.699730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 102/203] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:48:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:48:56.747554 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-aec8760d-a171-4048-8203-e66f79367fc8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.156858 Aug 30 07:48:56.748479 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 102/204] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:48:56 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:48:56.875977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c03805db-7aa0-4e54-817e-9dd279326cb9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:56.877086 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c03805db-7aa0-4e54-817e-9dd279326cb9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:56.888621 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c03805db-7aa0-4e54-817e-9dd279326cb9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:56.891520 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c03805db-7aa0-4e54-817e-9dd279326cb9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:56.892543 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c03805db-7aa0-4e54-817e-9dd279326cb9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:56.893453 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c03805db-7aa0-4e54-817e-9dd279326cb9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:57.235129 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c03805db-7aa0-4e54-817e-9dd279326cb9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:57.255676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c03805db-7aa0-4e54-817e-9dd279326cb9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.382439 Aug 30 07:48:57.257737 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 103/205] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:56 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:57.384680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1e01efc7-be1f-48d7-bb67-2e333e9fa360 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74787ad2-039e-48c3-af9c-9a519397e9dd"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:57.385873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1e01efc7-be1f-48d7-bb67-2e333e9fa360 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:57.393736 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e01efc7-be1f-48d7-bb67-2e333e9fa360 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:57.394217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e01efc7-be1f-48d7-bb67-2e333e9fa360 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:57.395186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e01efc7-be1f-48d7-bb67-2e333e9fa360 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:57.395762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e01efc7-be1f-48d7-bb67-2e333e9fa360 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:57.764152 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e1c5bef4-7dbf-4729-b872-ca97e287bf34 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:57.766017 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e1c5bef4-7dbf-4729-b872-ca97e287bf34 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:57.777991 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e1c5bef4-7dbf-4729-b872-ca97e287bf34 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:57.779203 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e1c5bef4-7dbf-4729-b872-ca97e287bf34 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:57.780110 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e1c5bef4-7dbf-4729-b872-ca97e287bf34 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:57.780747 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e1c5bef4-7dbf-4729-b872-ca97e287bf34 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:57.799924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1e01efc7-be1f-48d7-bb67-2e333e9fa360 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "POST /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.420209 Aug 30 07:48:57.800550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 103/206] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:48:57 2021] POST /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:48:57.911867 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e1c5bef4-7dbf-4729-b872-ca97e287bf34 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.155346 Aug 30 07:48:57.912242 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 104/207] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:48:57 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:48:58.280357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-362c116a-2715-4ea0-8d15-56d4718e6028 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:58.281067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-362c116a-2715-4ea0-8d15-56d4718e6028 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:58.289299 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-362c116a-2715-4ea0-8d15-56d4718e6028 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:58.290058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-362c116a-2715-4ea0-8d15-56d4718e6028 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:58.291182 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-362c116a-2715-4ea0-8d15-56d4718e6028 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:58.291971 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-362c116a-2715-4ea0-8d15-56d4718e6028 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:58.515969 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-362c116a-2715-4ea0-8d15-56d4718e6028 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:58.534991 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-362c116a-2715-4ea0-8d15-56d4718e6028 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.263477 Aug 30 07:48:58.536587 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 104/208] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:58 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:48:58.929855 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2c08c21f-2ed4-427c-b1c1-600307dd394f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:48:58.932804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2c08c21f-2ed4-427c-b1c1-600307dd394f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:58.953845 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c08c21f-2ed4-427c-b1c1-600307dd394f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:58.954684 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c08c21f-2ed4-427c-b1c1-600307dd394f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:58.955660 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c08c21f-2ed4-427c-b1c1-600307dd394f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:58.956455 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c08c21f-2ed4-427c-b1c1-600307dd394f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:59.116852 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2c08c21f-2ed4-427c-b1c1-600307dd394f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.193675 Aug 30 07:48:59.117519 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 105/209] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:48:58 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 07:48:59.554283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4b5c7888-a45d-4539-baaa-ab0340ce9300 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:48:59.555775 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4b5c7888-a45d-4539-baaa-ab0340ce9300 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:48:59.567779 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b5c7888-a45d-4539-baaa-ab0340ce9300 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:59.568427 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b5c7888-a45d-4539-baaa-ab0340ce9300 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:59.569208 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b5c7888-a45d-4539-baaa-ab0340ce9300 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:48:59.569654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b5c7888-a45d-4539-baaa-ab0340ce9300 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:48:59.713808 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4b5c7888-a45d-4539-baaa-ab0340ce9300 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:48:59.721299 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4b5c7888-a45d-4539-baaa-ab0340ce9300 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.173090 Aug 30 07:48:59.721875 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 105/210] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:48:59 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:00.128567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-73b47222-2c81-46bf-8001-b7a19b7cf4ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:00.129902 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-73b47222-2c81-46bf-8001-b7a19b7cf4ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:00.137049 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73b47222-2c81-46bf-8001-b7a19b7cf4ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:00.137644 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73b47222-2c81-46bf-8001-b7a19b7cf4ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:00.138464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73b47222-2c81-46bf-8001-b7a19b7cf4ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:00.138899 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73b47222-2c81-46bf-8001-b7a19b7cf4ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:00.236190 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-73b47222-2c81-46bf-8001-b7a19b7cf4ce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.111817 Aug 30 07:49:00.237310 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 106/211] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:00 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:49:00.738007 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d250a175-2c53-47d8-b573-1c152f2cedb3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:00.738643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d250a175-2c53-47d8-b573-1c152f2cedb3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:00.745722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d250a175-2c53-47d8-b573-1c152f2cedb3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:00.746192 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d250a175-2c53-47d8-b573-1c152f2cedb3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:00.747011 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d250a175-2c53-47d8-b573-1c152f2cedb3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:00.747438 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d250a175-2c53-47d8-b573-1c152f2cedb3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:00.873866 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d250a175-2c53-47d8-b573-1c152f2cedb3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:00.882483 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d250a175-2c53-47d8-b573-1c152f2cedb3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.148032 Aug 30 07:49:00.883069 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 106/212] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:00 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:01.246799 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-667507b0-3b93-47b8-85eb-bba4d5beaf36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:01.247856 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-667507b0-3b93-47b8-85eb-bba4d5beaf36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:01.254320 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-667507b0-3b93-47b8-85eb-bba4d5beaf36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:01.254766 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-667507b0-3b93-47b8-85eb-bba4d5beaf36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:01.255527 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-667507b0-3b93-47b8-85eb-bba4d5beaf36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:01.256211 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-667507b0-3b93-47b8-85eb-bba4d5beaf36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:01.323633 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-667507b0-3b93-47b8-85eb-bba4d5beaf36 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.080758 Aug 30 07:49:01.324426 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 107/213] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:01 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:49:01.899340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-808dfa15-a29a-4f16-98b3-4ac37bdb24ec tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:01.899987 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-808dfa15-a29a-4f16-98b3-4ac37bdb24ec tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:01.906249 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-808dfa15-a29a-4f16-98b3-4ac37bdb24ec tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:01.906704 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-808dfa15-a29a-4f16-98b3-4ac37bdb24ec tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:01.907498 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-808dfa15-a29a-4f16-98b3-4ac37bdb24ec tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:01.907931 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-808dfa15-a29a-4f16-98b3-4ac37bdb24ec tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:02.081114 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-808dfa15-a29a-4f16-98b3-4ac37bdb24ec tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:02.089207 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-808dfa15-a29a-4f16-98b3-4ac37bdb24ec tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.193640 Aug 30 07:49:02.089782 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 107/214] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:01 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:02.335670 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-72749b94-9212-4172-8ed6-0b3cbea10eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:02.337182 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-72749b94-9212-4172-8ed6-0b3cbea10eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:02.343558 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-72749b94-9212-4172-8ed6-0b3cbea10eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:02.344013 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-72749b94-9212-4172-8ed6-0b3cbea10eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:02.344782 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-72749b94-9212-4172-8ed6-0b3cbea10eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:02.345280 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-72749b94-9212-4172-8ed6-0b3cbea10eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:02.435852 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-72749b94-9212-4172-8ed6-0b3cbea10eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.104015 Aug 30 07:49:02.436471 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 108/215] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:02 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 07:49:03.105869 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-716f2c9a-20d6-4aac-887a-6a18e53d541e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:03.106513 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-716f2c9a-20d6-4aac-887a-6a18e53d541e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:03.112226 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-716f2c9a-20d6-4aac-887a-6a18e53d541e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:03.112673 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-716f2c9a-20d6-4aac-887a-6a18e53d541e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:03.113515 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-716f2c9a-20d6-4aac-887a-6a18e53d541e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:03.113885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-716f2c9a-20d6-4aac-887a-6a18e53d541e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:03.250298 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-716f2c9a-20d6-4aac-887a-6a18e53d541e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:03.267528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-716f2c9a-20d6-4aac-887a-6a18e53d541e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.165522 Aug 30 07:49:03.268325 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 108/216] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:03 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:03.447514 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-aa5253a3-0cef-47cd-ba6a-d5d997b0bed5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:03.448515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-aa5253a3-0cef-47cd-ba6a-d5d997b0bed5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:03.454899 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa5253a3-0cef-47cd-ba6a-d5d997b0bed5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:03.455351 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa5253a3-0cef-47cd-ba6a-d5d997b0bed5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:03.456110 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa5253a3-0cef-47cd-ba6a-d5d997b0bed5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:03.456546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa5253a3-0cef-47cd-ba6a-d5d997b0bed5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:03.539689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-aa5253a3-0cef-47cd-ba6a-d5d997b0bed5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.096134 Aug 30 07:49:03.540968 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 109/217] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:03 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:49:04.284767 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e1f74f3e-9ae1-4eb1-8490-7a372c9f55b1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:04.285410 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e1f74f3e-9ae1-4eb1-8490-7a372c9f55b1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:04.292594 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e1f74f3e-9ae1-4eb1-8490-7a372c9f55b1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:04.293047 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e1f74f3e-9ae1-4eb1-8490-7a372c9f55b1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:04.293821 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e1f74f3e-9ae1-4eb1-8490-7a372c9f55b1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:04.294285 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e1f74f3e-9ae1-4eb1-8490-7a372c9f55b1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:04.432341 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e1f74f3e-9ae1-4eb1-8490-7a372c9f55b1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:04.440033 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e1f74f3e-9ae1-4eb1-8490-7a372c9f55b1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.158941 Aug 30 07:49:04.440931 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 109/218] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:04 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:04.557895 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c5d88e85-3ad2-4d06-8b65-706da37e321f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:04.557895 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c5d88e85-3ad2-4d06-8b65-706da37e321f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:04.563096 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5d88e85-3ad2-4d06-8b65-706da37e321f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:04.563549 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5d88e85-3ad2-4d06-8b65-706da37e321f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:04.564533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5d88e85-3ad2-4d06-8b65-706da37e321f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:04.564941 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5d88e85-3ad2-4d06-8b65-706da37e321f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:04.688938 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c5d88e85-3ad2-4d06-8b65-706da37e321f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.140655 Aug 30 07:49:04.692121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 110/219] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:04 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:49:05.456506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b78f629c-8820-40bb-9042-74ba54a50949 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:05.457886 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b78f629c-8820-40bb-9042-74ba54a50949 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:05.466940 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b78f629c-8820-40bb-9042-74ba54a50949 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:05.466940 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b78f629c-8820-40bb-9042-74ba54a50949 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:05.467406 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b78f629c-8820-40bb-9042-74ba54a50949 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:05.468086 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b78f629c-8820-40bb-9042-74ba54a50949 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:05.473791 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1505310153", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "networks": [{"uuid": "48af5f56-a712-424c-ad52-bbe266bf5358"}]}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:05.624159 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b78f629c-8820-40bb-9042-74ba54a50949 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:05.632388 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b78f629c-8820-40bb-9042-74ba54a50949 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.179507 Aug 30 07:49:05.632960 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 110/220] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:05 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:05.700591 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-397fb2b7-0fed-42ad-9ce6-e3cac78e0db1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:05.701694 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-397fb2b7-0fed-42ad-9ce6-e3cac78e0db1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:05.708079 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-397fb2b7-0fed-42ad-9ce6-e3cac78e0db1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:05.708560 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-397fb2b7-0fed-42ad-9ce6-e3cac78e0db1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:05.709322 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-397fb2b7-0fed-42ad-9ce6-e3cac78e0db1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:05.709750 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-397fb2b7-0fed-42ad-9ce6-e3cac78e0db1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:05.790931 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-397fb2b7-0fed-42ad-9ce6-e3cac78e0db1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.090945 Aug 30 07:49:05.792385 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 111/221] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:05 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 07:49:06.652414 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9fe845d2-fc29-4b39-bd41-6de816ef0f6f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:06.653186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9fe845d2-fc29-4b39-bd41-6de816ef0f6f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:06.660327 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9fe845d2-fc29-4b39-bd41-6de816ef0f6f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:06.660775 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9fe845d2-fc29-4b39-bd41-6de816ef0f6f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:06.661550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9fe845d2-fc29-4b39-bd41-6de816ef0f6f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:06.661982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9fe845d2-fc29-4b39-bd41-6de816ef0f6f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:06.794320 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9fe845d2-fc29-4b39-bd41-6de816ef0f6f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:06.802494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9fe845d2-fc29-4b39-bd41-6de816ef0f6f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.156654 Aug 30 07:49:06.813279 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 112/222] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:06 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:06.818640 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-50c4e647-6b42-42f1-a2a7-c86040f2422f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:06.819979 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-50c4e647-6b42-42f1-a2a7-c86040f2422f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:06.828478 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50c4e647-6b42-42f1-a2a7-c86040f2422f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:06.828933 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50c4e647-6b42-42f1-a2a7-c86040f2422f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:06.829714 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50c4e647-6b42-42f1-a2a7-c86040f2422f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:06.830197 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50c4e647-6b42-42f1-a2a7-c86040f2422f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:06.949261 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-50c4e647-6b42-42f1-a2a7-c86040f2422f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.134158 Aug 30 07:49:06.950306 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 113/223] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:06 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:49:07.822631 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a12f4a04-d68c-41b9-9530-02e50c682dc2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:07.823602 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a12f4a04-d68c-41b9-9530-02e50c682dc2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:07.830938 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a12f4a04-d68c-41b9-9530-02e50c682dc2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:07.831393 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a12f4a04-d68c-41b9-9530-02e50c682dc2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:07.832160 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a12f4a04-d68c-41b9-9530-02e50c682dc2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:07.832790 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a12f4a04-d68c-41b9-9530-02e50c682dc2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:07.997783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a12f4a04-d68c-41b9-9530-02e50c682dc2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:08.006687 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a12f4a04-d68c-41b9-9530-02e50c682dc2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.189545 Aug 30 07:49:08.007479 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 114/224] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:07 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:08.012989 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b3bb273b-0730-4b2a-aa27-043630c6821a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:08.014080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b3bb273b-0730-4b2a-aa27-043630c6821a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:08.020561 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b3bb273b-0730-4b2a-aa27-043630c6821a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:08.021367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b3bb273b-0730-4b2a-aa27-043630c6821a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:08.022557 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b3bb273b-0730-4b2a-aa27-043630c6821a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:08.022933 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b3bb273b-0730-4b2a-aa27-043630c6821a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:08.108975 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b3bb273b-0730-4b2a-aa27-043630c6821a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.100071 Aug 30 07:49:08.109685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 115/225] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:08 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:49:09.024768 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2f25a1b5-f132-44e4-a34f-6c9deadc1cab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:09.025690 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2f25a1b5-f132-44e4-a34f-6c9deadc1cab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:09.032310 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f25a1b5-f132-44e4-a34f-6c9deadc1cab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:09.032738 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f25a1b5-f132-44e4-a34f-6c9deadc1cab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:09.033500 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f25a1b5-f132-44e4-a34f-6c9deadc1cab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:09.033935 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f25a1b5-f132-44e4-a34f-6c9deadc1cab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:09.225722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2f25a1b5-f132-44e4-a34f-6c9deadc1cab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:09.233866 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2f25a1b5-f132-44e4-a34f-6c9deadc1cab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.213198 Aug 30 07:49:09.234711 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 116/226] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:09 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:09.239175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-104591fb-6270-48ef-815e-a5a6d80ff07b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:09.240411 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-104591fb-6270-48ef-815e-a5a6d80ff07b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:09.253820 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-104591fb-6270-48ef-815e-a5a6d80ff07b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:09.254744 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-104591fb-6270-48ef-815e-a5a6d80ff07b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:09.255821 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-104591fb-6270-48ef-815e-a5a6d80ff07b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:09.256251 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-104591fb-6270-48ef-815e-a5a6d80ff07b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:09.345796 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-104591fb-6270-48ef-815e-a5a6d80ff07b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.109689 Aug 30 07:49:09.346534 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 117/227] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:09 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:49:10.256070 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ba9b70b8-0e1b-4dc0-bccb-f07930f6b8d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:10.256070 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ba9b70b8-0e1b-4dc0-bccb-f07930f6b8d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:10.263629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ba9b70b8-0e1b-4dc0-bccb-f07930f6b8d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:10.264074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ba9b70b8-0e1b-4dc0-bccb-f07930f6b8d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:10.264858 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ba9b70b8-0e1b-4dc0-bccb-f07930f6b8d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:10.265392 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ba9b70b8-0e1b-4dc0-bccb-f07930f6b8d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:10.496839 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ba9b70b8-0e1b-4dc0-bccb-f07930f6b8d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:10.504301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ba9b70b8-0e1b-4dc0-bccb-f07930f6b8d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.255806 Aug 30 07:49:10.504878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 118/228] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:10 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:10.510308 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-58209114-049d-48fe-86c2-13fbd80d38f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:10.511103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-58209114-049d-48fe-86c2-13fbd80d38f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:10.517167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-58209114-049d-48fe-86c2-13fbd80d38f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:10.517614 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-58209114-049d-48fe-86c2-13fbd80d38f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:10.518416 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-58209114-049d-48fe-86c2-13fbd80d38f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:10.518850 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-58209114-049d-48fe-86c2-13fbd80d38f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:10.627572 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-58209114-049d-48fe-86c2-13fbd80d38f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.121072 Aug 30 07:49:10.628470 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 119/229] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:10 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:49:11.523162 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ccc8d9db-47be-4eda-9d07-d7a0f53235cf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:11.523942 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ccc8d9db-47be-4eda-9d07-d7a0f53235cf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:11.530945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ccc8d9db-47be-4eda-9d07-d7a0f53235cf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:11.531401 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ccc8d9db-47be-4eda-9d07-d7a0f53235cf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:11.532193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ccc8d9db-47be-4eda-9d07-d7a0f53235cf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:11.532627 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ccc8d9db-47be-4eda-9d07-d7a0f53235cf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:11.658119 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ccc8d9db-47be-4eda-9d07-d7a0f53235cf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:11.666524 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ccc8d9db-47be-4eda-9d07-d7a0f53235cf tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.147488 Aug 30 07:49:11.667108 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 120/230] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:11 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:11.671536 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6c6cfb79-79f0-4f10-a5fc-7042df65fe89 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:11.672437 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6c6cfb79-79f0-4f10-a5fc-7042df65fe89 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:11.678592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6c6cfb79-79f0-4f10-a5fc-7042df65fe89 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:11.679042 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6c6cfb79-79f0-4f10-a5fc-7042df65fe89 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:11.679811 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6c6cfb79-79f0-4f10-a5fc-7042df65fe89 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:11.680811 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6c6cfb79-79f0-4f10-a5fc-7042df65fe89 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:11.779667 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6c6cfb79-79f0-4f10-a5fc-7042df65fe89 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 14 microversion: 2.1 time: 0.103720 Aug 30 07:49:11.779667 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 121/231] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:11 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:49:12.683984 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3190a4dd-607a-4a63-921c-4efdf080e62c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:12.684767 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3190a4dd-607a-4a63-921c-4efdf080e62c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:12.691912 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3190a4dd-607a-4a63-921c-4efdf080e62c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:12.691912 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3190a4dd-607a-4a63-921c-4efdf080e62c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:12.692596 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3190a4dd-607a-4a63-921c-4efdf080e62c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:12.693027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3190a4dd-607a-4a63-921c-4efdf080e62c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:12.824293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3190a4dd-607a-4a63-921c-4efdf080e62c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:12.831858 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3190a4dd-607a-4a63-921c-4efdf080e62c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.152364 Aug 30 07:49:12.832706 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 122/232] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:12 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:12.837675 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cf34303a-1cb8-413f-9a16-6bbc3ec2bd5e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:12.839854 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cf34303a-1cb8-413f-9a16-6bbc3ec2bd5e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:12.846499 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cf34303a-1cb8-413f-9a16-6bbc3ec2bd5e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:12.847238 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cf34303a-1cb8-413f-9a16-6bbc3ec2bd5e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:12.848256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cf34303a-1cb8-413f-9a16-6bbc3ec2bd5e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:12.848837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cf34303a-1cb8-413f-9a16-6bbc3ec2bd5e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:12.962267 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cf34303a-1cb8-413f-9a16-6bbc3ec2bd5e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 2514 microversion: 2.1 time: 0.128132 Aug 30 07:49:12.963052 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 123/233] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:12 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 2514 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:12.967952 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d19e50e0-d608-4ab3-929c-f7452c8622ef tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:12.968681 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d19e50e0-d608-4ab3-929c-f7452c8622ef tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:12.975337 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d19e50e0-d608-4ab3-929c-f7452c8622ef tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:12.975871 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d19e50e0-d608-4ab3-929c-f7452c8622ef tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:12.976700 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d19e50e0-d608-4ab3-929c-f7452c8622ef tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:12.977664 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d19e50e0-d608-4ab3-929c-f7452c8622ef tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:13.004404 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d19e50e0-d608-4ab3-929c-f7452c8622ef tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:49:13.092880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d19e50e0-d608-4ab3-929c-f7452c8622ef tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 204 len: 0 microversion: 2.1 time: 0.128314 Aug 30 07:49:13.093509 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 124/234] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:49:12 2021] DELETE /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:49:13.101430 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d6d40a38-45c4-45d1-bb51-b577aa32fa75 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:13.102687 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d6d40a38-45c4-45d1-bb51-b577aa32fa75 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:13.108607 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6d40a38-45c4-45d1-bb51-b577aa32fa75 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:13.109054 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6d40a38-45c4-45d1-bb51-b577aa32fa75 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:13.109818 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6d40a38-45c4-45d1-bb51-b577aa32fa75 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:13.110279 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6d40a38-45c4-45d1-bb51-b577aa32fa75 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:13.248937 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d6d40a38-45c4-45d1-bb51-b577aa32fa75 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:13.257075 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d6d40a38-45c4-45d1-bb51-b577aa32fa75 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1552 microversion: 2.1 time: 0.159378 Aug 30 07:49:13.257653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 125/235] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:13 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:13.848450 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-918dd719-636e-4fbd-90d9-516cd57400a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:13.849626 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-918dd719-636e-4fbd-90d9-516cd57400a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:13.855995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-918dd719-636e-4fbd-90d9-516cd57400a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:13.856433 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-918dd719-636e-4fbd-90d9-516cd57400a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:13.857196 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-918dd719-636e-4fbd-90d9-516cd57400a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:13.857620 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-918dd719-636e-4fbd-90d9-516cd57400a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:13.992791 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-918dd719-636e-4fbd-90d9-516cd57400a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:14.001523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-918dd719-636e-4fbd-90d9-516cd57400a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.156587 Aug 30 07:49:14.002735 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 126/236] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:13 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:14.008945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-20f94018-fc82-4c5c-87f7-2ab6aef6898f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:14.010938 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-20f94018-fc82-4c5c-87f7-2ab6aef6898f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:14.017655 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20f94018-fc82-4c5c-87f7-2ab6aef6898f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:14.018240 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20f94018-fc82-4c5c-87f7-2ab6aef6898f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:14.019102 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20f94018-fc82-4c5c-87f7-2ab6aef6898f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:14.019533 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20f94018-fc82-4c5c-87f7-2ab6aef6898f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:14.139833 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-20f94018-fc82-4c5c-87f7-2ab6aef6898f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 6451 microversion: 2.1 time: 0.135700 Aug 30 07:49:14.140557 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 127/237] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:14 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 6451 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:14.276004 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-41101f75-55df-4fd8-909e-643df3d1789c tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:14.276708 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-41101f75-55df-4fd8-909e-643df3d1789c tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:14.283334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-41101f75-55df-4fd8-909e-643df3d1789c tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:14.283782 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-41101f75-55df-4fd8-909e-643df3d1789c tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:14.284555 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-41101f75-55df-4fd8-909e-643df3d1789c tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:14.284987 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-41101f75-55df-4fd8-909e-643df3d1789c tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:14.415714 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-41101f75-55df-4fd8-909e-643df3d1789c tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:14.423897 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-41101f75-55df-4fd8-909e-643df3d1789c tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1552 microversion: 2.1 time: 0.152748 Aug 30 07:49:14.424646 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 128/238] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:14 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:15.019431 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-818f2e31-2eb6-4f92-8762-ddf7a901fa00 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:15.020100 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-818f2e31-2eb6-4f92-8762-ddf7a901fa00 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:15.026349 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-818f2e31-2eb6-4f92-8762-ddf7a901fa00 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:15.026798 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-818f2e31-2eb6-4f92-8762-ddf7a901fa00 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:15.027567 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-818f2e31-2eb6-4f92-8762-ddf7a901fa00 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:15.028001 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-818f2e31-2eb6-4f92-8762-ddf7a901fa00 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:15.158359 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-818f2e31-2eb6-4f92-8762-ddf7a901fa00 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:15.166525 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-818f2e31-2eb6-4f92-8762-ddf7a901fa00 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.150657 Aug 30 07:49:15.167284 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 129/239] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:15 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:15.171827 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0237d682-6c50-4189-876b-ce6814503798 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:15.172743 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0237d682-6c50-4189-876b-ce6814503798 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:15.184442 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0237d682-6c50-4189-876b-ce6814503798 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:15.185385 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0237d682-6c50-4189-876b-ce6814503798 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:15.186247 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0237d682-6c50-4189-876b-ce6814503798 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:15.186688 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0237d682-6c50-4189-876b-ce6814503798 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:15.315580 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0237d682-6c50-4189-876b-ce6814503798 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 8866 microversion: 2.1 time: 0.147187 Aug 30 07:49:15.316208 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 130/240] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:15 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 8866 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:15.441995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-961e456d-437d-4b68-8eda-55456fd2ab5e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:15.442742 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-961e456d-437d-4b68-8eda-55456fd2ab5e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:15.449564 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-961e456d-437d-4b68-8eda-55456fd2ab5e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:15.449963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-961e456d-437d-4b68-8eda-55456fd2ab5e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:15.450762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-961e456d-437d-4b68-8eda-55456fd2ab5e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:15.451282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-961e456d-437d-4b68-8eda-55456fd2ab5e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:15.589936 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-961e456d-437d-4b68-8eda-55456fd2ab5e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:15.598190 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-961e456d-437d-4b68-8eda-55456fd2ab5e tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1552 microversion: 2.1 time: 0.160082 Aug 30 07:49:15.598772 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 131/241] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:15 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:16.184257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e5af25b2-f51a-4a77-95d5-fd8c832eb56b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:16.185038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e5af25b2-f51a-4a77-95d5-fd8c832eb56b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:16.193450 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e5af25b2-f51a-4a77-95d5-fd8c832eb56b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:16.194276 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e5af25b2-f51a-4a77-95d5-fd8c832eb56b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:16.196419 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e5af25b2-f51a-4a77-95d5-fd8c832eb56b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:16.197578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e5af25b2-f51a-4a77-95d5-fd8c832eb56b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:16.481764 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e5af25b2-f51a-4a77-95d5-fd8c832eb56b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:16.492192 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e5af25b2-f51a-4a77-95d5-fd8c832eb56b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.311217 Aug 30 07:49:16.493527 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 132/242] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:16 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:16.498657 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5aa5cc70-0fbf-453d-a42d-57f6e1562af0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:16.499080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5aa5cc70-0fbf-453d-a42d-57f6e1562af0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:16.507630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5aa5cc70-0fbf-453d-a42d-57f6e1562af0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:16.508780 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5aa5cc70-0fbf-453d-a42d-57f6e1562af0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:16.509739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5aa5cc70-0fbf-453d-a42d-57f6e1562af0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:16.510276 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5aa5cc70-0fbf-453d-a42d-57f6e1562af0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:16.623943 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5aa5cc70-0fbf-453d-a42d-57f6e1562af0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 12181 microversion: 2.1 time: 0.128835 Aug 30 07:49:16.624393 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 133/243] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:16 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 12181 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:16.631524 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dd8562ef-5e7a-47e6-b1bd-4c18659d4139 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:16.632341 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dd8562ef-5e7a-47e6-b1bd-4c18659d4139 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:16.640109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd8562ef-5e7a-47e6-b1bd-4c18659d4139 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:16.640639 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd8562ef-5e7a-47e6-b1bd-4c18659d4139 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:16.641431 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd8562ef-5e7a-47e6-b1bd-4c18659d4139 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:16.641871 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd8562ef-5e7a-47e6-b1bd-4c18659d4139 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:16.782691 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-dd8562ef-5e7a-47e6-b1bd-4c18659d4139 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:16.792767 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dd8562ef-5e7a-47e6-b1bd-4c18659d4139 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1552 microversion: 2.1 time: 0.167036 Aug 30 07:49:16.793345 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 134/244] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:16 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:17.357183 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-8d3adef9-318f-411e-8039-b352043fff7d req-5b256064-67d0-44d3-8b50-9ad76861a4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7e7530-d91c-4112-98e3-e0297020dfb6", "name": "network-vif-deleted", "tag": "708e585c-b3c8-47c5-afdf-a68c26eb49ca"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:17.359282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:49:17.359282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:49:17.366642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-8d3adef9-318f-411e-8039-b352043fff7d req-5b256064-67d0-44d3-8b50-9ad76861a4ad service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:17.367117 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-8d3adef9-318f-411e-8039-b352043fff7d req-5b256064-67d0-44d3-8b50-9ad76861a4ad service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:17.379432 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-8d3adef9-318f-411e-8039-b352043fff7d req-5b256064-67d0-44d3-8b50-9ad76861a4ad service nova] Creating event network-vif-deleted:708e585c-b3c8-47c5-afdf-a68c26eb49ca for instance bf7e7530-d91c-4112-98e3-e0297020dfb6 on hv-cinder-80619 Aug 30 07:49:17.385430 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-8d3adef9-318f-411e-8039-b352043fff7d req-5b256064-67d0-44d3-8b50-9ad76861a4ad service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032102 Aug 30 07:49:17.386065 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 135/245] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:49:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:49:17.510253 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-581212cc-7baa-4fe2-996d-1ffa5ab365c2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:17.510869 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-581212cc-7baa-4fe2-996d-1ffa5ab365c2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:17.518101 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-581212cc-7baa-4fe2-996d-1ffa5ab365c2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:17.518101 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-581212cc-7baa-4fe2-996d-1ffa5ab365c2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:17.518536 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-581212cc-7baa-4fe2-996d-1ffa5ab365c2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:17.518972 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-581212cc-7baa-4fe2-996d-1ffa5ab365c2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:17.663190 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-581212cc-7baa-4fe2-996d-1ffa5ab365c2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:17.672145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-581212cc-7baa-4fe2-996d-1ffa5ab365c2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.166676 Aug 30 07:49:17.672736 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 136/246] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:17 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:17.677437 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6e27f2d7-7194-4826-a8d3-9b83df1744f0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:17.678556 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6e27f2d7-7194-4826-a8d3-9b83df1744f0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:17.685053 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6e27f2d7-7194-4826-a8d3-9b83df1744f0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:17.685521 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6e27f2d7-7194-4826-a8d3-9b83df1744f0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:17.686355 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6e27f2d7-7194-4826-a8d3-9b83df1744f0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:17.686789 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6e27f2d7-7194-4826-a8d3-9b83df1744f0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:17.785934 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6e27f2d7-7194-4826-a8d3-9b83df1744f0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 16026 microversion: 2.1 time: 0.111931 Aug 30 07:49:17.786808 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 137/247] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:17 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 16026 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:17.817225 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-64485ae8-20c5-42e1-a8be-ba0c1e4d1765 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:17.817940 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-64485ae8-20c5-42e1-a8be-ba0c1e4d1765 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:17.825039 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-64485ae8-20c5-42e1-a8be-ba0c1e4d1765 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:17.825758 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-64485ae8-20c5-42e1-a8be-ba0c1e4d1765 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:17.826570 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-64485ae8-20c5-42e1-a8be-ba0c1e4d1765 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:17.827257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-64485ae8-20c5-42e1-a8be-ba0c1e4d1765 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:17.901681 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-64485ae8-20c5-42e1-a8be-ba0c1e4d1765 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd403d89366cb42fabbdd51486035af19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf66595a4b84cdd93e7a1eb55bb40f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:17.911411 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-64485ae8-20c5-42e1-a8be-ba0c1e4d1765 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 200 len: 1345 microversion: 2.1 time: 0.105345 Aug 30 07:49:17.911993 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 138/248] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:17 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 1345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:18.690740 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b5cc0aa0-153b-4f0f-a44b-4880994be280 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:18.691488 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b5cc0aa0-153b-4f0f-a44b-4880994be280 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:18.697876 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b5cc0aa0-153b-4f0f-a44b-4880994be280 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:18.698440 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b5cc0aa0-153b-4f0f-a44b-4880994be280 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:18.699424 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b5cc0aa0-153b-4f0f-a44b-4880994be280 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:18.700003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b5cc0aa0-153b-4f0f-a44b-4880994be280 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:18.832542 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b5cc0aa0-153b-4f0f-a44b-4880994be280 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:18.840716 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b5cc0aa0-153b-4f0f-a44b-4880994be280 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.153692 Aug 30 07:49:18.841301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 139/249] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:18 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:18.845759 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9ae204d7-d261-4566-b71d-637baeaec747 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:18.846704 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9ae204d7-d261-4566-b71d-637baeaec747 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:18.853391 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9ae204d7-d261-4566-b71d-637baeaec747 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:18.853834 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9ae204d7-d261-4566-b71d-637baeaec747 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:18.854636 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9ae204d7-d261-4566-b71d-637baeaec747 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:18.855086 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9ae204d7-d261-4566-b71d-637baeaec747 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:18.941002 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9ae204d7-d261-4566-b71d-637baeaec747 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 17744 microversion: 2.1 time: 0.098347 Aug 30 07:49:18.945969 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 140/250] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:18 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 17744 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:18.947080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-206b7225-a708-4e71-abc4-485c9c3e6d81 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:18.947816 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-206b7225-a708-4e71-abc4-485c9c3e6d81 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:18.954422 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-206b7225-a708-4e71-abc4-485c9c3e6d81 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:18.954868 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-206b7225-a708-4e71-abc4-485c9c3e6d81 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:18.955637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-206b7225-a708-4e71-abc4-485c9c3e6d81 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:18.956072 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-206b7225-a708-4e71-abc4-485c9c3e6d81 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:18.971582 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-206b7225-a708-4e71-abc4-485c9c3e6d81 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] HTTP exception thrown: Instance bf7e7530-d91c-4112-98e3-e0297020dfb6 could not be found. Aug 30 07:49:18.971803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-206b7225-a708-4e71-abc4-485c9c3e6d81 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Returning 404 to user: Instance bf7e7530-d91c-4112-98e3-e0297020dfb6 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:49:18.972597 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-206b7225-a708-4e71-abc4-485c9c3e6d81 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 404 len: 111 microversion: 2.1 time: 0.029898 Aug 30 07:49:18.973107 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 141/251] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:18 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:49:19.090684 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ace5500b-cff5-40fe-8be1-042cd30b7216 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:19.091642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ace5500b-cff5-40fe-8be1-042cd30b7216 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:19.097912 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ace5500b-cff5-40fe-8be1-042cd30b7216 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:19.098306 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ace5500b-cff5-40fe-8be1-042cd30b7216 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:19.099084 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ace5500b-cff5-40fe-8be1-042cd30b7216 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:19.099519 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ace5500b-cff5-40fe-8be1-042cd30b7216 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:19.113272 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-ace5500b-cff5-40fe-8be1-042cd30b7216 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] HTTP exception thrown: Instance bf7e7530-d91c-4112-98e3-e0297020dfb6 could not be found. Aug 30 07:49:19.113874 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ace5500b-cff5-40fe-8be1-042cd30b7216 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Returning 404 to user: Instance bf7e7530-d91c-4112-98e3-e0297020dfb6 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:49:19.114801 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ace5500b-cff5-40fe-8be1-042cd30b7216 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028615 Aug 30 07:49:19.115569 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 142/252] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:49:19 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:49:19.859209 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d01aa2d2-3c57-40eb-8f62-1996e67525e2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:19.860552 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d01aa2d2-3c57-40eb-8f62-1996e67525e2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:19.867140 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d01aa2d2-3c57-40eb-8f62-1996e67525e2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:19.867876 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d01aa2d2-3c57-40eb-8f62-1996e67525e2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:19.868625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d01aa2d2-3c57-40eb-8f62-1996e67525e2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:19.869007 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d01aa2d2-3c57-40eb-8f62-1996e67525e2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:20.017487 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d01aa2d2-3c57-40eb-8f62-1996e67525e2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:20.026083 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d01aa2d2-3c57-40eb-8f62-1996e67525e2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.170570 Aug 30 07:49:20.026754 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 143/253] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:19 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:20.031968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e78378cb-2005-4f39-85e3-5d273e8d8483 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:20.032919 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e78378cb-2005-4f39-85e3-5d273e8d8483 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:20.043548 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e78378cb-2005-4f39-85e3-5d273e8d8483 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:20.044349 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e78378cb-2005-4f39-85e3-5d273e8d8483 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:20.045487 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e78378cb-2005-4f39-85e3-5d273e8d8483 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:20.046310 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e78378cb-2005-4f39-85e3-5d273e8d8483 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:20.161857 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e78378cb-2005-4f39-85e3-5d273e8d8483 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 19295 microversion: 2.1 time: 0.133480 Aug 30 07:49:20.162286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 144/254] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:20 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 19295 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:20.436113 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8fe5da5f-135d-48e8-82a8-01374e61d1d5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:20.436717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8fe5da5f-135d-48e8-82a8-01374e61d1d5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:20.444037 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8fe5da5f-135d-48e8-82a8-01374e61d1d5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:20.444492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8fe5da5f-135d-48e8-82a8-01374e61d1d5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:20.445826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8fe5da5f-135d-48e8-82a8-01374e61d1d5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:20.446415 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8fe5da5f-135d-48e8-82a8-01374e61d1d5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:20.466475 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-8fe5da5f-135d-48e8-82a8-01374e61d1d5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] HTTP exception thrown: Instance bf7e7530-d91c-4112-98e3-e0297020dfb6 could not be found. Aug 30 07:49:20.467074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8fe5da5f-135d-48e8-82a8-01374e61d1d5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Returning 404 to user: Instance bf7e7530-d91c-4112-98e3-e0297020dfb6 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:49:20.467927 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8fe5da5f-135d-48e8-82a8-01374e61d1d5 tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 404 len: 111 microversion: 2.1 time: 0.035912 Aug 30 07:49:20.468492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 145/255] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:49:20 2021] DELETE /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:49:20.477481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8ae1229e-4bd5-456b-afcd-f1004cf677fa tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:20.478103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8ae1229e-4bd5-456b-afcd-f1004cf677fa tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] [instance: bf7e7530-d91c-4112-98e3-e0297020dfb6] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:20.484577 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8ae1229e-4bd5-456b-afcd-f1004cf677fa tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:20.485016 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8ae1229e-4bd5-456b-afcd-f1004cf677fa tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:20.485805 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8ae1229e-4bd5-456b-afcd-f1004cf677fa tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:20.486286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8ae1229e-4bd5-456b-afcd-f1004cf677fa tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:20.501979 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-8ae1229e-4bd5-456b-afcd-f1004cf677fa tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] HTTP exception thrown: Instance bf7e7530-d91c-4112-98e3-e0297020dfb6 could not be found. Aug 30 07:49:20.502697 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8ae1229e-4bd5-456b-afcd-f1004cf677fa tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] Returning 404 to user: Instance bf7e7530-d91c-4112-98e3-e0297020dfb6 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:49:20.503769 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8ae1229e-4bd5-456b-afcd-f1004cf677fa tempest-DeleteServersTestJSON-848238148 tempest-DeleteServersTestJSON-848238148-project] 10.222.0.73 "GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6" status: 404 len: 111 microversion: 2.1 time: 0.029930 Aug 30 07:49:20.504420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 146/256] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:20 2021] GET /compute/v2.1/servers/bf7e7530-d91c-4112-98e3-e0297020dfb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:49:21.045241 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6a98bd3a-a148-4e80-9d6e-dc098c41b2db tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:21.046076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6a98bd3a-a148-4e80-9d6e-dc098c41b2db tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:21.055891 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a98bd3a-a148-4e80-9d6e-dc098c41b2db tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:21.056524 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a98bd3a-a148-4e80-9d6e-dc098c41b2db tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:21.057386 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a98bd3a-a148-4e80-9d6e-dc098c41b2db tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:21.058031 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a98bd3a-a148-4e80-9d6e-dc098c41b2db tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:21.230799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6a98bd3a-a148-4e80-9d6e-dc098c41b2db tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:21.238294 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6a98bd3a-a148-4e80-9d6e-dc098c41b2db tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.197937 Aug 30 07:49:21.238881 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 147/257] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:21 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:21.243554 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c55129d9-c24b-4107-8f00-21266ac9f145 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:21.244489 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c55129d9-c24b-4107-8f00-21266ac9f145 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:21.250769 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c55129d9-c24b-4107-8f00-21266ac9f145 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:21.251216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c55129d9-c24b-4107-8f00-21266ac9f145 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:21.252002 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c55129d9-c24b-4107-8f00-21266ac9f145 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:21.252434 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c55129d9-c24b-4107-8f00-21266ac9f145 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:21.388582 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c55129d9-c24b-4107-8f00-21266ac9f145 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 20991 microversion: 2.1 time: 0.148431 Aug 30 07:49:21.389585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 148/258] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:21 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 20991 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:21.670869 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] validate_networks() for [('48af5f56-a712-424c-ad52-bbe266bf5358', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:49:22.257057 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cc0f0df8-f218-438e-9675-ddd3edbbb668 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:22.257734 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cc0f0df8-f218-438e-9675-ddd3edbbb668 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:22.265958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc0f0df8-f218-438e-9675-ddd3edbbb668 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:22.266581 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc0f0df8-f218-438e-9675-ddd3edbbb668 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:22.267559 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc0f0df8-f218-438e-9675-ddd3edbbb668 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:22.268209 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc0f0df8-f218-438e-9675-ddd3edbbb668 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:22.388102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:49:22.388696 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:49:22.389287 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:49:22.389834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:49:22.390516 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:49:22.407336 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:22.408802 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:22.410054 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:22.410776 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:22.433004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Getting quotas for project b7540de7f257475e864b4023460d355a. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:49:22.438228 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Getting quotas for user 93170b4e61c9470ba9b7ec6bb66e86e0 and project b7540de7f257475e864b4023460d355a. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:49:22.454515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:49:22.458504 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:49:22.465829 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-cc0f0df8-f218-438e-9675-ddd3edbbb668 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:22.474724 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cc0f0df8-f218-438e-9675-ddd3edbbb668 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.222790 Aug 30 07:49:22.486540 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 149/259] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:22 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:22.491706 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-31c2200e-a7d3-4fcd-9390-dd88617828c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:22.493295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-31c2200e-a7d3-4fcd-9390-dd88617828c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:22.503883 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31c2200e-a7d3-4fcd-9390-dd88617828c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:22.503883 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31c2200e-a7d3-4fcd-9390-dd88617828c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:22.504405 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31c2200e-a7d3-4fcd-9390-dd88617828c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:22.505099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31c2200e-a7d3-4fcd-9390-dd88617828c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:22.527536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c4288ad6-5e5a-4beb-9745-48ed240532bf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 17.057790 Aug 30 07:49:22.528493 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 111/260] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:49:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 17060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:49:22.539691 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c52b849c-0390-4613-b4e9-7abfa589331c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:22.540242 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c52b849c-0390-4613-b4e9-7abfa589331c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:22.616568 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-31c2200e-a7d3-4fcd-9390-dd88617828c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 22548 microversion: 2.1 time: 0.127315 Aug 30 07:49:22.619349 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 150/261] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:22 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 22548 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:22.628330 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c52b849c-0390-4613-b4e9-7abfa589331c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:22.641599 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c52b849c-0390-4613-b4e9-7abfa589331c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1218 microversion: 2.1 time: 0.106208 Aug 30 07:49:22.642907 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 112/262] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:22 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:23.494643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ea09f385-461c-4cc1-ae6d-1100872ad9bc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:23.495601 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ea09f385-461c-4cc1-ae6d-1100872ad9bc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:23.509911 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea09f385-461c-4cc1-ae6d-1100872ad9bc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:23.516145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea09f385-461c-4cc1-ae6d-1100872ad9bc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:23.516145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea09f385-461c-4cc1-ae6d-1100872ad9bc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:23.516145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea09f385-461c-4cc1-ae6d-1100872ad9bc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:23.629589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6192f71c-b85a-4531-960e-f5139c64b1fe tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:23.630899 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6192f71c-b85a-4531-960e-f5139c64b1fe tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:23.650890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6192f71c-b85a-4531-960e-f5139c64b1fe tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:23.651343 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6192f71c-b85a-4531-960e-f5139c64b1fe tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:23.652143 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6192f71c-b85a-4531-960e-f5139c64b1fe tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:23.652588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6192f71c-b85a-4531-960e-f5139c64b1fe tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:23.743302 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ea09f385-461c-4cc1-ae6d-1100872ad9bc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:23.750051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ea09f385-461c-4cc1-ae6d-1100872ad9bc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.260886 Aug 30 07:49:23.751400 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 151/263] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:23 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:23.757286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7c5ce792-9ada-41c7-a908-1d9a9fd106c3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:23.758904 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7c5ce792-9ada-41c7-a908-1d9a9fd106c3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:23.774193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c5ce792-9ada-41c7-a908-1d9a9fd106c3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:23.775311 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c5ce792-9ada-41c7-a908-1d9a9fd106c3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:23.776384 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c5ce792-9ada-41c7-a908-1d9a9fd106c3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:23.776844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c5ce792-9ada-41c7-a908-1d9a9fd106c3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:23.806375 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6192f71c-b85a-4531-960e-f5139c64b1fe tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 23233 microversion: 2.1 time: 0.177934 Aug 30 07:49:23.808109 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 113/264] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:23 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 23233 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:49:23.884746 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7c5ce792-9ada-41c7-a908-1d9a9fd106c3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:23.905252 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7c5ce792-9ada-41c7-a908-1d9a9fd106c3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1270 microversion: 2.1 time: 0.151987 Aug 30 07:49:23.906432 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 152/265] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:23 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:24.774533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2150bf02-dfff-4c54-a68b-ca699c63abeb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:24.775745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2150bf02-dfff-4c54-a68b-ca699c63abeb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:24.785176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2150bf02-dfff-4c54-a68b-ca699c63abeb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:24.785902 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2150bf02-dfff-4c54-a68b-ca699c63abeb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:24.787234 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2150bf02-dfff-4c54-a68b-ca699c63abeb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:24.788024 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2150bf02-dfff-4c54-a68b-ca699c63abeb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:24.821993 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-72e92edb-2adc-4e08-a69f-c968684fdf98 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:24.822756 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-72e92edb-2adc-4e08-a69f-c968684fdf98 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:24.836097 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72e92edb-2adc-4e08-a69f-c968684fdf98 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:24.836825 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72e92edb-2adc-4e08-a69f-c968684fdf98 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:24.837820 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72e92edb-2adc-4e08-a69f-c968684fdf98 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:24.838974 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72e92edb-2adc-4e08-a69f-c968684fdf98 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:24.970107 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-72e92edb-2adc-4e08-a69f-c968684fdf98 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 24356 microversion: 2.1 time: 0.153462 Aug 30 07:49:24.972872 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 153/266] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:24 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 24356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:49:24.984045 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d4e52cb6-8f80-4658-a4b2-6ea1b81ae89a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:24.985574 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d4e52cb6-8f80-4658-a4b2-6ea1b81ae89a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:24.996402 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4e52cb6-8f80-4658-a4b2-6ea1b81ae89a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:24.997763 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4e52cb6-8f80-4658-a4b2-6ea1b81ae89a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:24.999331 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4e52cb6-8f80-4658-a4b2-6ea1b81ae89a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:25.000073 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4e52cb6-8f80-4658-a4b2-6ea1b81ae89a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:25.105919 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d4e52cb6-8f80-4658-a4b2-6ea1b81ae89a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:25.116099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d4e52cb6-8f80-4658-a4b2-6ea1b81ae89a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1276 microversion: 2.1 time: 0.140895 Aug 30 07:49:25.116699 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 154/267] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:24 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:25.319036 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2150bf02-dfff-4c54-a68b-ca699c63abeb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:25.329566 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2150bf02-dfff-4c54-a68b-ca699c63abeb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.561398 Aug 30 07:49:25.331559 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 114/268] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:24 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:25.989969 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-eb8886a6-266c-4340-b99d-c07c85ad4605 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:25.991927 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-eb8886a6-266c-4340-b99d-c07c85ad4605 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:26.030974 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eb8886a6-266c-4340-b99d-c07c85ad4605 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:26.032891 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eb8886a6-266c-4340-b99d-c07c85ad4605 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:26.039928 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eb8886a6-266c-4340-b99d-c07c85ad4605 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:26.041272 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eb8886a6-266c-4340-b99d-c07c85ad4605 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:26.144995 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2b28c9fb-9ab2-4391-9dd9-783f4f3c518a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:26.147489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2b28c9fb-9ab2-4391-9dd9-783f4f3c518a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:26.155055 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b28c9fb-9ab2-4391-9dd9-783f4f3c518a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:26.155775 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b28c9fb-9ab2-4391-9dd9-783f4f3c518a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:26.156785 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b28c9fb-9ab2-4391-9dd9-783f4f3c518a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:26.157946 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b28c9fb-9ab2-4391-9dd9-783f4f3c518a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:26.184630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-eb8886a6-266c-4340-b99d-c07c85ad4605 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 24911 microversion: 2.1 time: 0.201800 Aug 30 07:49:26.189590 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 155/269] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:25 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 24911 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:26.370296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-80035e87-9b1d-43d0-bcfd-f82c5014e5fd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:26.370296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-80035e87-9b1d-43d0-bcfd-f82c5014e5fd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:26.394669 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80035e87-9b1d-43d0-bcfd-f82c5014e5fd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:26.397779 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80035e87-9b1d-43d0-bcfd-f82c5014e5fd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:26.400053 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80035e87-9b1d-43d0-bcfd-f82c5014e5fd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:26.400921 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80035e87-9b1d-43d0-bcfd-f82c5014e5fd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:26.658563 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-80035e87-9b1d-43d0-bcfd-f82c5014e5fd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:26.676097 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-80035e87-9b1d-43d0-bcfd-f82c5014e5fd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.321211 Aug 30 07:49:26.677288 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 156/270] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:26 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:26.758003 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2b28c9fb-9ab2-4391-9dd9-783f4f3c518a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:26.766922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2b28c9fb-9ab2-4391-9dd9-783f4f3c518a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.629728 Aug 30 07:49:26.767512 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 115/271] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:26 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:27.204455 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bdf75ea5-ecb8-4092-87e8-a3f698d9a7b2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:27.205527 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bdf75ea5-ecb8-4092-87e8-a3f698d9a7b2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:27.224934 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bdf75ea5-ecb8-4092-87e8-a3f698d9a7b2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:27.226500 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bdf75ea5-ecb8-4092-87e8-a3f698d9a7b2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:27.229618 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bdf75ea5-ecb8-4092-87e8-a3f698d9a7b2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:27.231029 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bdf75ea5-ecb8-4092-87e8-a3f698d9a7b2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:27.341733 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bdf75ea5-ecb8-4092-87e8-a3f698d9a7b2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 25753 microversion: 2.1 time: 0.146146 Aug 30 07:49:27.342796 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 157/272] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:27 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 25753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:27.698497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4dcd67fd-6801-48e3-9108-882279bec3d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:27.699880 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4dcd67fd-6801-48e3-9108-882279bec3d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:27.707718 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4dcd67fd-6801-48e3-9108-882279bec3d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:27.708461 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4dcd67fd-6801-48e3-9108-882279bec3d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:27.709437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4dcd67fd-6801-48e3-9108-882279bec3d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:27.710050 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4dcd67fd-6801-48e3-9108-882279bec3d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:27.784081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-9d97fcd8-ebb3-4e14-9104-56eb6fe458e0 req-1ece1ebb-162b-4e1e-9372-4a5dbe1b8023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb", "tag": "68f1f892-73b9-4984-bfa6-c10491ed1939"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:27.785653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:49:27.785653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:49:27.800265 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-9d97fcd8-ebb3-4e14-9104-56eb6fe458e0 req-1ece1ebb-162b-4e1e-9372-4a5dbe1b8023 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:27.801307 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-9d97fcd8-ebb3-4e14-9104-56eb6fe458e0 req-1ece1ebb-162b-4e1e-9372-4a5dbe1b8023 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:27.818184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-9d97fcd8-ebb3-4e14-9104-56eb6fe458e0 req-1ece1ebb-162b-4e1e-9372-4a5dbe1b8023 service nova] Creating event network-changed:68f1f892-73b9-4984-bfa6-c10491ed1939 for instance 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb on hv-cinder-80619 Aug 30 07:49:27.824829 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-9d97fcd8-ebb3-4e14-9104-56eb6fe458e0 req-1ece1ebb-162b-4e1e-9372-4a5dbe1b8023 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047761 Aug 30 07:49:27.826007 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 158/273] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:49:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:49:27.833861 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-291023fa-b0e8-41f2-80e7-b1284c7d9127 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:27.834891 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-291023fa-b0e8-41f2-80e7-b1284c7d9127 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:27.843473 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-291023fa-b0e8-41f2-80e7-b1284c7d9127 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:27.844307 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-291023fa-b0e8-41f2-80e7-b1284c7d9127 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:27.845271 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-291023fa-b0e8-41f2-80e7-b1284c7d9127 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:27.845863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-291023fa-b0e8-41f2-80e7-b1284c7d9127 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:28.144117 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-291023fa-b0e8-41f2-80e7-b1284c7d9127 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:28.159109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-291023fa-b0e8-41f2-80e7-b1284c7d9127 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.330867 Aug 30 07:49:28.160673 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 159/274] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:27 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:28.196477 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4dcd67fd-6801-48e3-9108-882279bec3d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:28.219164 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4dcd67fd-6801-48e3-9108-882279bec3d6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.525465 Aug 30 07:49:28.221612 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 116/275] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:27 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:28.360586 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-71dfdc95-dc1f-47bf-9546-77d68011679a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:28.363749 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-71dfdc95-dc1f-47bf-9546-77d68011679a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:28.376424 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-71dfdc95-dc1f-47bf-9546-77d68011679a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:28.377589 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-71dfdc95-dc1f-47bf-9546-77d68011679a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:28.379360 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-71dfdc95-dc1f-47bf-9546-77d68011679a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:28.380896 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-71dfdc95-dc1f-47bf-9546-77d68011679a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:28.512842 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-71dfdc95-dc1f-47bf-9546-77d68011679a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 26341 microversion: 2.1 time: 0.158788 Aug 30 07:49:28.512842 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 160/276] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:28 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 26341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:29.178856 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fe8b890a-9ce8-45dd-9898-bec8ccfe2afb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:29.181080 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fe8b890a-9ce8-45dd-9898-bec8ccfe2afb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:29.191305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fe8b890a-9ce8-45dd-9898-bec8ccfe2afb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:29.192178 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fe8b890a-9ce8-45dd-9898-bec8ccfe2afb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:29.193311 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fe8b890a-9ce8-45dd-9898-bec8ccfe2afb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:29.193981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fe8b890a-9ce8-45dd-9898-bec8ccfe2afb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:29.248085 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a647c6d9-6686-46ec-917f-20c0b1bd15fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:29.248753 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a647c6d9-6686-46ec-917f-20c0b1bd15fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:29.262469 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a647c6d9-6686-46ec-917f-20c0b1bd15fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:29.262984 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a647c6d9-6686-46ec-917f-20c0b1bd15fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:29.263969 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a647c6d9-6686-46ec-917f-20c0b1bd15fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:29.264610 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a647c6d9-6686-46ec-917f-20c0b1bd15fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:29.450953 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a647c6d9-6686-46ec-917f-20c0b1bd15fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:29.459805 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a647c6d9-6686-46ec-917f-20c0b1bd15fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.216105 Aug 30 07:49:29.460616 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 161/277] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:29 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:29.527873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dd165da5-6afe-42c8-b03e-34e0cc7957b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:29.529996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dd165da5-6afe-42c8-b03e-34e0cc7957b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:29.542370 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd165da5-6afe-42c8-b03e-34e0cc7957b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:29.543182 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd165da5-6afe-42c8-b03e-34e0cc7957b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:29.544888 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd165da5-6afe-42c8-b03e-34e0cc7957b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:29.545734 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd165da5-6afe-42c8-b03e-34e0cc7957b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:29.669651 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-fe8b890a-9ce8-45dd-9898-bec8ccfe2afb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:29.675468 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dd165da5-6afe-42c8-b03e-34e0cc7957b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 26965 microversion: 2.1 time: 0.150385 Aug 30 07:49:29.682059 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 162/278] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:29 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 26965 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:29.682472 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fe8b890a-9ce8-45dd-9898-bec8ccfe2afb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.507654 Aug 30 07:49:29.682472 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 117/279] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:29 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:30.478700 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9409889c-0286-4178-a9b7-78fa513bd575 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:30.479689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9409889c-0286-4178-a9b7-78fa513bd575 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:30.499368 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9409889c-0286-4178-a9b7-78fa513bd575 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:30.499605 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9409889c-0286-4178-a9b7-78fa513bd575 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:30.502202 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9409889c-0286-4178-a9b7-78fa513bd575 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:30.513774 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9409889c-0286-4178-a9b7-78fa513bd575 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:30.690644 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cda54eea-0b83-417e-8bff-0d250998e055 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:30.692771 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cda54eea-0b83-417e-8bff-0d250998e055 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:30.705814 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cda54eea-0b83-417e-8bff-0d250998e055 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:30.706995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cda54eea-0b83-417e-8bff-0d250998e055 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:30.708051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cda54eea-0b83-417e-8bff-0d250998e055 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:30.708676 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cda54eea-0b83-417e-8bff-0d250998e055 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:30.838217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cda54eea-0b83-417e-8bff-0d250998e055 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 27501 microversion: 2.1 time: 0.150935 Aug 30 07:49:30.844145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 163/280] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:30 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 27501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:49:30.851745 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9b3889ab-41bb-40ff-bed0-09c77d851960 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:30.852839 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9b3889ab-41bb-40ff-bed0-09c77d851960 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:30.868062 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b3889ab-41bb-40ff-bed0-09c77d851960 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:30.869062 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b3889ab-41bb-40ff-bed0-09c77d851960 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:30.870098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b3889ab-41bb-40ff-bed0-09c77d851960 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:30.870946 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b3889ab-41bb-40ff-bed0-09c77d851960 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:31.026746 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9409889c-0286-4178-a9b7-78fa513bd575 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:31.038122 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9409889c-0286-4178-a9b7-78fa513bd575 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.564123 Aug 30 07:49:31.039484 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 118/281] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:30 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:31.099893 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9b3889ab-41bb-40ff-bed0-09c77d851960 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:31.112014 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9b3889ab-41bb-40ff-bed0-09c77d851960 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.265780 Aug 30 07:49:31.113330 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 164/282] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:30 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:31.855816 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-11442d9e-7402-40a3-b2b4-7e1e62ea45cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:31.858304 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-11442d9e-7402-40a3-b2b4-7e1e62ea45cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:31.869372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-11442d9e-7402-40a3-b2b4-7e1e62ea45cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:31.870233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-11442d9e-7402-40a3-b2b4-7e1e62ea45cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:31.884487 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-11442d9e-7402-40a3-b2b4-7e1e62ea45cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:31.885176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-11442d9e-7402-40a3-b2b4-7e1e62ea45cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:32.059157 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6de6c58f-b158-4fe0-b0ee-cb90b3d7ec86 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:32.060247 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6de6c58f-b158-4fe0-b0ee-cb90b3d7ec86 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:32.067697 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6de6c58f-b158-4fe0-b0ee-cb90b3d7ec86 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:32.068151 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6de6c58f-b158-4fe0-b0ee-cb90b3d7ec86 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:32.068945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6de6c58f-b158-4fe0-b0ee-cb90b3d7ec86 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:32.069381 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6de6c58f-b158-4fe0-b0ee-cb90b3d7ec86 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:32.123362 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-11442d9e-7402-40a3-b2b4-7e1e62ea45cc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 27686 microversion: 2.1 time: 0.275031 Aug 30 07:49:32.128227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 119/283] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:31 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 27686 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:32.139608 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-39964b61-a0df-409e-aa92-e568a6ddb3d8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:32.140432 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-39964b61-a0df-409e-aa92-e568a6ddb3d8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:32.153474 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-39964b61-a0df-409e-aa92-e568a6ddb3d8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:32.155363 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-39964b61-a0df-409e-aa92-e568a6ddb3d8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:32.158220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-39964b61-a0df-409e-aa92-e568a6ddb3d8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:32.158820 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-39964b61-a0df-409e-aa92-e568a6ddb3d8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:32.281397 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6de6c58f-b158-4fe0-b0ee-cb90b3d7ec86 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:32.293622 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6de6c58f-b158-4fe0-b0ee-cb90b3d7ec86 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.241254 Aug 30 07:49:32.312225 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 165/284] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:32 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:32.374376 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-39964b61-a0df-409e-aa92-e568a6ddb3d8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:32.389421 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-39964b61-a0df-409e-aa92-e568a6ddb3d8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.253695 Aug 30 07:49:32.391088 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 120/285] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:32 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:32.690898 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4aaf5c7e-f4b8-45f8-b906-520ae72a6bc3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'create', calling method: .version_select at 0x7f341ccf05e0>, body: {"keypair": {"name": "tempest-keypair-311285817"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:32.724564 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-4aaf5c7e-f4b8-45f8-b906-520ae72a6bc3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for project 46a024ebf24f430393b00d5d8777b746. Resources: {'key_pairs'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:49:32.730233 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-4aaf5c7e-f4b8-45f8-b906-520ae72a6bc3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for user cd0b9269e5fb4c6fa880c5217149b229 and project 46a024ebf24f430393b00d5d8777b746. Resources: {'key_pairs'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:49:33.111211 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-4aaf5c7e-f4b8-45f8-b906-520ae72a6bc3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for project 46a024ebf24f430393b00d5d8777b746. Resources: {'key_pairs'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:49:33.117206 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-4aaf5c7e-f4b8-45f8-b906-520ae72a6bc3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for user cd0b9269e5fb4c6fa880c5217149b229 and project 46a024ebf24f430393b00d5d8777b746. Resources: {'key_pairs'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:49:33.138224 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4eee8313-a23e-44d0-837b-c3b64906fff8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:33.138816 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4eee8313-a23e-44d0-837b-c3b64906fff8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:33.144081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4aaf5c7e-f4b8-45f8-b906-520ae72a6bc3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.794228 Aug 30 07:49:33.145800 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4eee8313-a23e-44d0-837b-c3b64906fff8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:33.146504 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4eee8313-a23e-44d0-837b-c3b64906fff8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:33.147464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4eee8313-a23e-44d0-837b-c3b64906fff8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:33.148636 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4eee8313-a23e-44d0-837b-c3b64906fff8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:33.152506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 166/286] 10.222.0.73 () {62 vars in 1199 bytes} [Mon Aug 30 07:49:32 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 803 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Aug 30 07:49:33.256197 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4eee8313-a23e-44d0-837b-c3b64906fff8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 27745 microversion: 2.1 time: 0.122743 Aug 30 07:49:33.257576 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 121/287] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:33 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 27745 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:49:33.335318 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-509c8aa4-5cf8-404e-80b0-08b298dc1023 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:33.336717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-509c8aa4-5cf8-404e-80b0-08b298dc1023 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:33.346309 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-509c8aa4-5cf8-404e-80b0-08b298dc1023 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:33.347758 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-509c8aa4-5cf8-404e-80b0-08b298dc1023 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:33.350295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-509c8aa4-5cf8-404e-80b0-08b298dc1023 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:33.352023 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-509c8aa4-5cf8-404e-80b0-08b298dc1023 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:33.409299 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-df2d700d-ffc1-4786-a340-0749304c7648 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:33.410259 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-df2d700d-ffc1-4786-a340-0749304c7648 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:33.419837 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df2d700d-ffc1-4786-a340-0749304c7648 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:33.420295 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df2d700d-ffc1-4786-a340-0749304c7648 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:33.421102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df2d700d-ffc1-4786-a340-0749304c7648 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:33.421542 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df2d700d-ffc1-4786-a340-0749304c7648 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:33.651656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-df2d700d-ffc1-4786-a340-0749304c7648 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:33.663314 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-df2d700d-ffc1-4786-a340-0749304c7648 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.258947 Aug 30 07:49:33.675450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 122/288] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:33 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:33.679795 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-509c8aa4-5cf8-404e-80b0-08b298dc1023 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:33.697293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-509c8aa4-5cf8-404e-80b0-08b298dc1023 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.370567 Aug 30 07:49:33.698219 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 167/289] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:33 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:34.272320 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-72f79fec-5c45-4586-937a-3db1871875d6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:34.277182 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-72f79fec-5c45-4586-937a-3db1871875d6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:34.289080 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-72f79fec-5c45-4586-937a-3db1871875d6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:34.290384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-72f79fec-5c45-4586-937a-3db1871875d6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:34.291744 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-72f79fec-5c45-4586-937a-3db1871875d6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:34.292848 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-72f79fec-5c45-4586-937a-3db1871875d6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:34.557967 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-72f79fec-5c45-4586-937a-3db1871875d6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 27932 microversion: 2.1 time: 0.290826 Aug 30 07:49:34.565183 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 123/290] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:34 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 27932 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:34.686438 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-132d5d15-b769-4d8b-8632-634ff52e9d7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:34.687718 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-132d5d15-b769-4d8b-8632-634ff52e9d7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:34.698080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-132d5d15-b769-4d8b-8632-634ff52e9d7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:34.699498 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-132d5d15-b769-4d8b-8632-634ff52e9d7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:34.701747 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-132d5d15-b769-4d8b-8632-634ff52e9d7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:34.703050 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-132d5d15-b769-4d8b-8632-634ff52e9d7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:34.727713 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-eb34d4d9-a2b3-4c59-8bcf-6258737ef44b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:34.732928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-eb34d4d9-a2b3-4c59-8bcf-6258737ef44b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:34.773567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb34d4d9-a2b3-4c59-8bcf-6258737ef44b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:34.776300 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb34d4d9-a2b3-4c59-8bcf-6258737ef44b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:34.778085 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb34d4d9-a2b3-4c59-8bcf-6258737ef44b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:34.779727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb34d4d9-a2b3-4c59-8bcf-6258737ef44b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:35.005709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-132d5d15-b769-4d8b-8632-634ff52e9d7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:35.016287 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-132d5d15-b769-4d8b-8632-634ff52e9d7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.338029 Aug 30 07:49:35.017424 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 168/291] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:34 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:35.128534 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-eb34d4d9-a2b3-4c59-8bcf-6258737ef44b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:35.137822 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-eb34d4d9-a2b3-4c59-8bcf-6258737ef44b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.418564 Aug 30 07:49:35.138798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 124/292] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:34 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:35.573064 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-99f2af98-743f-42c2-88b3-a142f126b016 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:35.574076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-99f2af98-743f-42c2-88b3-a142f126b016 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:35.597976 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-99f2af98-743f-42c2-88b3-a142f126b016 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:35.598456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-99f2af98-743f-42c2-88b3-a142f126b016 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:35.599245 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-99f2af98-743f-42c2-88b3-a142f126b016 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:35.599683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-99f2af98-743f-42c2-88b3-a142f126b016 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:35.600042 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-117590829", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac8b0384-c5fa-4cad-beab-0f002d9bca24"}], "security_groups": [{"name": "tempest-securitygroup--1365511934"}], "key_name": "tempest-keypair-311285817", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:35.726225 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-99f2af98-743f-42c2-88b3-a142f126b016 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28049 microversion: 2.1 time: 0.157128 Aug 30 07:49:35.729973 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 169/293] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:35 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28049 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:49:35.767692 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] validate_networks() for [('ac8b0384-c5fa-4cad-beab-0f002d9bca24', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:49:36.048590 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b3e24fc2-ccca-46d2-8d18-57abc94cc6d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:36.049583 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b3e24fc2-ccca-46d2-8d18-57abc94cc6d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:36.083686 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b3e24fc2-ccca-46d2-8d18-57abc94cc6d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:36.084133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b3e24fc2-ccca-46d2-8d18-57abc94cc6d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:36.085581 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b3e24fc2-ccca-46d2-8d18-57abc94cc6d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:36.086298 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b3e24fc2-ccca-46d2-8d18-57abc94cc6d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:36.267486 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b3e24fc2-ccca-46d2-8d18-57abc94cc6d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:36.276815 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b3e24fc2-ccca-46d2-8d18-57abc94cc6d7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.233865 Aug 30 07:49:36.277410 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 170/294] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:36 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:36.282399 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cc400798-dbd8-418f-875b-afe427240336 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:36.283029 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cc400798-dbd8-418f-875b-afe427240336 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:36.289856 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc400798-dbd8-418f-875b-afe427240336 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:36.290452 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc400798-dbd8-418f-875b-afe427240336 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:36.291288 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc400798-dbd8-418f-875b-afe427240336 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:36.291738 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc400798-dbd8-418f-875b-afe427240336 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:36.444809 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:49:36.445241 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:49:36.445714 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:49:36.446611 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:49:36.447400 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:49:36.448784 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-cc400798-dbd8-418f-875b-afe427240336 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:36.457710 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:36.458179 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:36.458529 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cc400798-dbd8-418f-875b-afe427240336 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.179981 Aug 30 07:49:36.458992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:36.459429 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:36.459566 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 171/295] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:36 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:36.481610 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for project 46a024ebf24f430393b00d5d8777b746. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:49:36.485938 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for user cd0b9269e5fb4c6fa880c5217149b229 and project 46a024ebf24f430393b00d5d8777b746. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:49:36.498305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:49:36.500662 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:49:36.557500 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-220be541-b55b-4d9e-b3e4-eb6266c1a508 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.961655 Aug 30 07:49:36.558064 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 125/296] 10.222.0.73 () {62 vars in 1188 bytes} [Mon Aug 30 07:49:35 2021] POST /compute/v2.1/servers => generated 402 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 07:49:36.568350 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-954225ad-13ca-4a8b-bb98-da5db3f157cf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:36.569276 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-954225ad-13ca-4a8b-bb98-da5db3f157cf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:36.627680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-954225ad-13ca-4a8b-bb98-da5db3f157cf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:36.639769 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-954225ad-13ca-4a8b-bb98-da5db3f157cf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:36.642435 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-954225ad-13ca-4a8b-bb98-da5db3f157cf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:36.644179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-954225ad-13ca-4a8b-bb98-da5db3f157cf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1280 microversion: 2.20 time: 0.079535 Aug 30 07:49:36.645098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 172/297] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:36 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:49:36.744821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e30ee2d6-fd9f-4c85-9935-7adf0de7fd52 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:36.745831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e30ee2d6-fd9f-4c85-9935-7adf0de7fd52 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:36.752304 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e30ee2d6-fd9f-4c85-9935-7adf0de7fd52 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:36.752808 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e30ee2d6-fd9f-4c85-9935-7adf0de7fd52 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:36.753479 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e30ee2d6-fd9f-4c85-9935-7adf0de7fd52 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:36.753903 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e30ee2d6-fd9f-4c85-9935-7adf0de7fd52 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:36.860769 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e30ee2d6-fd9f-4c85-9935-7adf0de7fd52 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28049 microversion: 2.1 time: 0.122689 Aug 30 07:49:36.863647 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 126/298] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:36 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28049 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:37.294902 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-37ed73fa-d833-416c-aa48-49829eaf3702 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:37.295759 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-37ed73fa-d833-416c-aa48-49829eaf3702 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:37.305061 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37ed73fa-d833-416c-aa48-49829eaf3702 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:37.305593 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37ed73fa-d833-416c-aa48-49829eaf3702 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:37.306411 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37ed73fa-d833-416c-aa48-49829eaf3702 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:37.306874 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37ed73fa-d833-416c-aa48-49829eaf3702 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:37.468426 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-37ed73fa-d833-416c-aa48-49829eaf3702 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:37.477184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-37ed73fa-d833-416c-aa48-49829eaf3702 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.186934 Aug 30 07:49:37.477378 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d930e60c-1ce4-4c0a-8a4b-dce1528638bb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:37.477992 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 173/299] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:37 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:37.478127 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d930e60c-1ce4-4c0a-8a4b-dce1528638bb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:37.484700 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d930e60c-1ce4-4c0a-8a4b-dce1528638bb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:37.485145 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d930e60c-1ce4-4c0a-8a4b-dce1528638bb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:37.485914 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d930e60c-1ce4-4c0a-8a4b-dce1528638bb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:37.486380 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d930e60c-1ce4-4c0a-8a4b-dce1528638bb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:37.612082 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d930e60c-1ce4-4c0a-8a4b-dce1528638bb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:37.620539 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d930e60c-1ce4-4c0a-8a4b-dce1528638bb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.147471 Aug 30 07:49:37.621111 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 127/300] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:37 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:37.670839 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-16d2d55d-dcb9-4cdf-a0ba-16377d585dec tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:37.671526 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-16d2d55d-dcb9-4cdf-a0ba-16377d585dec tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:37.680057 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-16d2d55d-dcb9-4cdf-a0ba-16377d585dec tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:37.680698 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-16d2d55d-dcb9-4cdf-a0ba-16377d585dec tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:37.681476 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-16d2d55d-dcb9-4cdf-a0ba-16377d585dec tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:37.681927 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-16d2d55d-dcb9-4cdf-a0ba-16377d585dec tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:37.758296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-16d2d55d-dcb9-4cdf-a0ba-16377d585dec tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:37.767342 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-16d2d55d-dcb9-4cdf-a0ba-16377d585dec tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:37.769815 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-16d2d55d-dcb9-4cdf-a0ba-16377d585dec tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:37.771442 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-16d2d55d-dcb9-4cdf-a0ba-16377d585dec tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1340 microversion: 2.20 time: 0.104599 Aug 30 07:49:37.772081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 174/301] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:37 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1340 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:49:37.873233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3c559cf7-d6c7-47bf-971b-01720dbfbdad tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:37.874784 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3c559cf7-d6c7-47bf-971b-01720dbfbdad tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:37.881858 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3c559cf7-d6c7-47bf-971b-01720dbfbdad tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:37.882367 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3c559cf7-d6c7-47bf-971b-01720dbfbdad tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:37.883124 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3c559cf7-d6c7-47bf-971b-01720dbfbdad tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:37.883584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3c559cf7-d6c7-47bf-971b-01720dbfbdad tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:37.975228 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3c559cf7-d6c7-47bf-971b-01720dbfbdad tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.105441 Aug 30 07:49:37.980122 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 128/302] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:37 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:38.256126 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-11886c66-bdd1-422c-9f5a-e793068beb79 req-5973dac7-df48-421f-a95b-c9db47d247ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb", "name": "network-vif-plugged", "status": "completed", "tag": "68f1f892-73b9-4984-bfa6-c10491ed1939"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:38.258512 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:49:38.258512 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:49:38.274001 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-11886c66-bdd1-422c-9f5a-e793068beb79 req-5973dac7-df48-421f-a95b-c9db47d247ac service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:38.275578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-11886c66-bdd1-422c-9f5a-e793068beb79 req-5973dac7-df48-421f-a95b-c9db47d247ac service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:38.297365 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-11886c66-bdd1-422c-9f5a-e793068beb79 req-5973dac7-df48-421f-a95b-c9db47d247ac service nova] Creating event network-vif-plugged:68f1f892-73b9-4984-bfa6-c10491ed1939 for instance 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb on hv-cinder-80619 Aug 30 07:49:38.304240 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-11886c66-bdd1-422c-9f5a-e793068beb79 req-5973dac7-df48-421f-a95b-c9db47d247ac service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053195 Aug 30 07:49:38.305455 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 175/303] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:49:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:49:38.501647 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5f46d9b0-e9b8-4a27-9ce9-f6088151c95f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:38.507128 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5f46d9b0-e9b8-4a27-9ce9-f6088151c95f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:38.521988 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f46d9b0-e9b8-4a27-9ce9-f6088151c95f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:38.523164 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f46d9b0-e9b8-4a27-9ce9-f6088151c95f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:38.523984 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f46d9b0-e9b8-4a27-9ce9-f6088151c95f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:38.526007 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f46d9b0-e9b8-4a27-9ce9-f6088151c95f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:38.641973 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-118c525b-6867-45d1-a374-216b8a792a64 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:38.644229 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-118c525b-6867-45d1-a374-216b8a792a64 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:38.656984 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-118c525b-6867-45d1-a374-216b8a792a64 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:38.657815 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-118c525b-6867-45d1-a374-216b8a792a64 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:38.659695 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-118c525b-6867-45d1-a374-216b8a792a64 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:38.660697 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-118c525b-6867-45d1-a374-216b8a792a64 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:38.825627 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5f46d9b0-e9b8-4a27-9ce9-f6088151c95f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:38.834450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5f46d9b0-e9b8-4a27-9ce9-f6088151c95f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.336669 Aug 30 07:49:38.835659 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 129/304] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:38 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:38.841523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-00c96cb3-b027-4888-988e-9d9a1ab8cb5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:38.842638 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-00c96cb3-b027-4888-988e-9d9a1ab8cb5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:38.848982 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00c96cb3-b027-4888-988e-9d9a1ab8cb5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:38.849540 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00c96cb3-b027-4888-988e-9d9a1ab8cb5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:38.850414 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00c96cb3-b027-4888-988e-9d9a1ab8cb5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:38.851754 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00c96cb3-b027-4888-988e-9d9a1ab8cb5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:38.909248 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-118c525b-6867-45d1-a374-216b8a792a64 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:38.921261 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-118c525b-6867-45d1-a374-216b8a792a64 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.285377 Aug 30 07:49:38.922218 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 176/305] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:38 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:38.987950 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-22cd6807-abd0-45ef-991c-17bdd98b14ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:38.989923 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-22cd6807-abd0-45ef-991c-17bdd98b14ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:38.998453 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-22cd6807-abd0-45ef-991c-17bdd98b14ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:38.999210 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-22cd6807-abd0-45ef-991c-17bdd98b14ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:39.000428 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-22cd6807-abd0-45ef-991c-17bdd98b14ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:39.001145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-22cd6807-abd0-45ef-991c-17bdd98b14ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:39.130556 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-22cd6807-abd0-45ef-991c-17bdd98b14ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.145953 Aug 30 07:49:39.132113 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 177/306] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:38 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:49:39.180803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-00c96cb3-b027-4888-988e-9d9a1ab8cb5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:39.188999 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-00c96cb3-b027-4888-988e-9d9a1ab8cb5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:39.190690 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-00c96cb3-b027-4888-988e-9d9a1ab8cb5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:39.191970 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-00c96cb3-b027-4888-988e-9d9a1ab8cb5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.354979 Aug 30 07:49:39.192805 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 130/307] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:38 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:49:39.643191 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-e5db8f44-d1bd-40ef-b972-c19e0e470fa0 req-b44675a9-40f0-40f7-ba20-3c06ab722fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f", "tag": "32f744e1-43b5-4cbe-a3b6-9ee81f793879"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:39.646234 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:49:39.646234 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:49:39.669297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-e5db8f44-d1bd-40ef-b972-c19e0e470fa0 req-b44675a9-40f0-40f7-ba20-3c06ab722fda service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:39.669864 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-e5db8f44-d1bd-40ef-b972-c19e0e470fa0 req-b44675a9-40f0-40f7-ba20-3c06ab722fda service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:39.683444 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-e5db8f44-d1bd-40ef-b972-c19e0e470fa0 req-b44675a9-40f0-40f7-ba20-3c06ab722fda service nova] Creating event network-changed:32f744e1-43b5-4cbe-a3b6-9ee81f793879 for instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f on hv-cinder-80619 Aug 30 07:49:39.693757 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-e5db8f44-d1bd-40ef-b972-c19e0e470fa0 req-b44675a9-40f0-40f7-ba20-3c06ab722fda service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054401 Aug 30 07:49:39.699606 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 178/308] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:49:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:49:39.855181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e791e44d-8925-4f04-a5bd-566088b4c214 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:39.856013 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e791e44d-8925-4f04-a5bd-566088b4c214 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:39.864039 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e791e44d-8925-4f04-a5bd-566088b4c214 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:39.864667 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e791e44d-8925-4f04-a5bd-566088b4c214 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:39.865455 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e791e44d-8925-4f04-a5bd-566088b4c214 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:39.867062 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e791e44d-8925-4f04-a5bd-566088b4c214 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:39.943003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-af3d9a0f-3541-4168-a500-401d5da993a4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:39.944625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-af3d9a0f-3541-4168-a500-401d5da993a4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:39.956424 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af3d9a0f-3541-4168-a500-401d5da993a4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:39.957565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af3d9a0f-3541-4168-a500-401d5da993a4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:39.959114 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af3d9a0f-3541-4168-a500-401d5da993a4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:39.960316 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af3d9a0f-3541-4168-a500-401d5da993a4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:40.121816 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e791e44d-8925-4f04-a5bd-566088b4c214 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:40.131824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e791e44d-8925-4f04-a5bd-566088b4c214 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.281409 Aug 30 07:49:40.132201 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 131/309] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:39 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:40.151929 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4dacc489-ea15-488c-908b-50170e150412 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:40.153032 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4dacc489-ea15-488c-908b-50170e150412 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:40.161133 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4dacc489-ea15-488c-908b-50170e150412 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:40.161595 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4dacc489-ea15-488c-908b-50170e150412 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:40.162572 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4dacc489-ea15-488c-908b-50170e150412 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:40.163589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4dacc489-ea15-488c-908b-50170e150412 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:40.173547 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-af3d9a0f-3541-4168-a500-401d5da993a4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:40.183459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-af3d9a0f-3541-4168-a500-401d5da993a4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.247845 Aug 30 07:49:40.187423 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 179/310] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:39 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:40.211756 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bd9e91ad-d7f6-4293-b48b-b4c1529cd40a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:40.212427 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bd9e91ad-d7f6-4293-b48b-b4c1529cd40a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:40.219484 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bd9e91ad-d7f6-4293-b48b-b4c1529cd40a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:40.219980 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bd9e91ad-d7f6-4293-b48b-b4c1529cd40a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:40.220835 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bd9e91ad-d7f6-4293-b48b-b4c1529cd40a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:40.221354 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bd9e91ad-d7f6-4293-b48b-b4c1529cd40a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:40.306092 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4dacc489-ea15-488c-908b-50170e150412 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.164208 Aug 30 07:49:40.312359 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 132/311] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:40 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:40.393494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-bd9e91ad-d7f6-4293-b48b-b4c1529cd40a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:40.408501 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-bd9e91ad-d7f6-4293-b48b-b4c1529cd40a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:40.410115 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-bd9e91ad-d7f6-4293-b48b-b4c1529cd40a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:40.411306 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bd9e91ad-d7f6-4293-b48b-b4c1529cd40a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.203917 Aug 30 07:49:40.412108 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 180/312] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:40 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:49:41.155980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3fc45adc-9523-476a-bb84-23fbc8f1cb74 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:41.157739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3fc45adc-9523-476a-bb84-23fbc8f1cb74 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:41.184576 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3fc45adc-9523-476a-bb84-23fbc8f1cb74 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:41.186334 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3fc45adc-9523-476a-bb84-23fbc8f1cb74 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:41.187856 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3fc45adc-9523-476a-bb84-23fbc8f1cb74 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:41.188636 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3fc45adc-9523-476a-bb84-23fbc8f1cb74 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:41.247775 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3b79d0ed-60ac-496b-8923-ac33c149cd43 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:41.248404 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3b79d0ed-60ac-496b-8923-ac33c149cd43 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:41.256219 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3b79d0ed-60ac-496b-8923-ac33c149cd43 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:41.257455 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3b79d0ed-60ac-496b-8923-ac33c149cd43 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:41.258297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3b79d0ed-60ac-496b-8923-ac33c149cd43 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:41.258732 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3b79d0ed-60ac-496b-8923-ac33c149cd43 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:41.403537 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3fc45adc-9523-476a-bb84-23fbc8f1cb74 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:41.411160 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3fc45adc-9523-476a-bb84-23fbc8f1cb74 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1318 microversion: 2.1 time: 0.265064 Aug 30 07:49:41.412447 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 133/313] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:41 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:41.419159 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b55f98b4-6191-4832-b134-892c67ec02f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:41.420438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b55f98b4-6191-4832-b134-892c67ec02f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:41.427182 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b55f98b4-6191-4832-b134-892c67ec02f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:41.427995 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b55f98b4-6191-4832-b134-892c67ec02f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:41.429239 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b55f98b4-6191-4832-b134-892c67ec02f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:41.429900 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b55f98b4-6191-4832-b134-892c67ec02f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:41.546764 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b55f98b4-6191-4832-b134-892c67ec02f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.130825 Aug 30 07:49:41.548128 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 134/314] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:41 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:41.554590 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-059f03a1-61ca-4ae5-810c-d0c69a5f2cf0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:41.555252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-059f03a1-61ca-4ae5-810c-d0c69a5f2cf0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:41.562115 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-059f03a1-61ca-4ae5-810c-d0c69a5f2cf0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:41.562481 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-059f03a1-61ca-4ae5-810c-d0c69a5f2cf0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:41.563116 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-059f03a1-61ca-4ae5-810c-d0c69a5f2cf0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:41.563558 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-059f03a1-61ca-4ae5-810c-d0c69a5f2cf0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:41.745339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-059f03a1-61ca-4ae5-810c-d0c69a5f2cf0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:41.754881 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-059f03a1-61ca-4ae5-810c-d0c69a5f2cf0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:41.757520 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-059f03a1-61ca-4ae5-810c-d0c69a5f2cf0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:41.758956 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-059f03a1-61ca-4ae5-810c-d0c69a5f2cf0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.209481 Aug 30 07:49:41.759659 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 135/315] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:41 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:49:41.780073 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3b79d0ed-60ac-496b-8923-ac33c149cd43 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:41.789241 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3b79d0ed-60ac-496b-8923-ac33c149cd43 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.550764 Aug 30 07:49:41.790082 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 181/316] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:41 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:42.430644 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a5b9f556-3bde-459a-b531-48758528642d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:42.431266 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a5b9f556-3bde-459a-b531-48758528642d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:42.437507 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a5b9f556-3bde-459a-b531-48758528642d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.438099 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a5b9f556-3bde-459a-b531-48758528642d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:42.438925 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a5b9f556-3bde-459a-b531-48758528642d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.439367 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a5b9f556-3bde-459a-b531-48758528642d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:42.560341 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-83d58ed0-7d8e-4e01-a613-25e9a5d4c11a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:42.563169 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-83d58ed0-7d8e-4e01-a613-25e9a5d4c11a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:42.571250 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-83d58ed0-7d8e-4e01-a613-25e9a5d4c11a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.572947 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-83d58ed0-7d8e-4e01-a613-25e9a5d4c11a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:42.574702 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-83d58ed0-7d8e-4e01-a613-25e9a5d4c11a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.575612 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-83d58ed0-7d8e-4e01-a613-25e9a5d4c11a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:42.607343 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a5b9f556-3bde-459a-b531-48758528642d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:42.617265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a5b9f556-3bde-459a-b531-48758528642d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1507 microversion: 2.1 time: 0.191072 Aug 30 07:49:42.622678 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 136/317] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:42 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:42.640497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-904c1caa-7e66-42cc-a38a-f48a7c4884d2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfafd178-bc3b-4ef2-9edb-70419a45d8fb"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:42.642402 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-904c1caa-7e66-42cc-a38a-f48a7c4884d2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:42.651530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-904c1caa-7e66-42cc-a38a-f48a7c4884d2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.652010 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-904c1caa-7e66-42cc-a38a-f48a7c4884d2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:42.652845 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-904c1caa-7e66-42cc-a38a-f48a7c4884d2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.653623 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-904c1caa-7e66-42cc-a38a-f48a7c4884d2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:42.743435 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-904c1caa-7e66-42cc-a38a-f48a7c4884d2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] HTTP exception thrown: Invalid volume: volume bfafd178-bc3b-4ef2-9edb-70419a45d8fb is already attached to instances: 4967d79f-d77e-494e-913b-b11b09a5dee4 Aug 30 07:49:42.744055 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-904c1caa-7e66-42cc-a38a-f48a7c4884d2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Returning 400 to user: Invalid volume: volume bfafd178-bc3b-4ef2-9edb-70419a45d8fb is already attached to instances: 4967d79f-d77e-494e-913b-b11b09a5dee4 {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:49:42.745045 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-904c1caa-7e66-42cc-a38a-f48a7c4884d2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "POST /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114239 Aug 30 07:49:42.745737 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 137/318] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:49:42 2021] POST /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 07:49:42.784631 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-563e5a15-691f-4902-b744-57471e6cccdd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:42.785639 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-563e5a15-691f-4902-b744-57471e6cccdd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:42.792986 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-563e5a15-691f-4902-b744-57471e6cccdd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.793487 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-563e5a15-691f-4902-b744-57471e6cccdd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:42.794286 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-563e5a15-691f-4902-b744-57471e6cccdd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.794717 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-563e5a15-691f-4902-b744-57471e6cccdd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:42.883494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-83d58ed0-7d8e-4e01-a613-25e9a5d4c11a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.327137 Aug 30 07:49:42.884136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 182/319] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:42 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:49:42.889407 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e8731f33-e441-469e-9624-8502aa2fa2b5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:42.890092 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e8731f33-e441-469e-9624-8502aa2fa2b5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:42.896208 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e8731f33-e441-469e-9624-8502aa2fa2b5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.896654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e8731f33-e441-469e-9624-8502aa2fa2b5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:42.898115 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e8731f33-e441-469e-9624-8502aa2fa2b5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.898778 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e8731f33-e441-469e-9624-8502aa2fa2b5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:42.924619 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-563e5a15-691f-4902-b744-57471e6cccdd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:42.933650 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-563e5a15-691f-4902-b744-57471e6cccdd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:42.935255 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-563e5a15-691f-4902-b744-57471e6cccdd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:42.936376 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-563e5a15-691f-4902-b744-57471e6cccdd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.156195 Aug 30 07:49:42.936939 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 138/320] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:42 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:49:42.942061 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8b8fdcfb-4107-4d88-bb73-e635ca32ad2f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:42.942602 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8b8fdcfb-4107-4d88-bb73-e635ca32ad2f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:42.962749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b8fdcfb-4107-4d88-bb73-e635ca32ad2f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.963327 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b8fdcfb-4107-4d88-bb73-e635ca32ad2f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:42.964262 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b8fdcfb-4107-4d88-bb73-e635ca32ad2f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:42.964912 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b8fdcfb-4107-4d88-bb73-e635ca32ad2f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:43.040946 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e8731f33-e441-469e-9624-8502aa2fa2b5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:43.048465 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e8731f33-e441-469e-9624-8502aa2fa2b5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.163152 Aug 30 07:49:43.049041 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 183/321] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:42 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:43.106624 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-8b8fdcfb-4107-4d88-bb73-e635ca32ad2f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lazy-loading 'services' on Instance uuid 4967d79f-d77e-494e-913b-b11b09a5dee4 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:49:43.218684 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8b8fdcfb-4107-4d88-bb73-e635ca32ad2f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments/bfafd178-bc3b-4ef2-9edb-70419a45d8fb" status: 202 len: 0 microversion: 2.1 time: 0.280249 Aug 30 07:49:43.219269 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 139/322] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:49:42 2021] DELETE /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments/bfafd178-bc3b-4ef2-9edb-70419a45d8fb => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:49:43.228798 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-54a5cc37-3c5e-47e9-9cd8-8f5aad70db28 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:43.229738 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-54a5cc37-3c5e-47e9-9cd8-8f5aad70db28 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:43.235972 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54a5cc37-3c5e-47e9-9cd8-8f5aad70db28 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:43.236427 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54a5cc37-3c5e-47e9-9cd8-8f5aad70db28 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:43.237235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54a5cc37-3c5e-47e9-9cd8-8f5aad70db28 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:43.237645 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54a5cc37-3c5e-47e9-9cd8-8f5aad70db28 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:43.274759 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-54a5cc37-3c5e-47e9-9cd8-8f5aad70db28 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049978 Aug 30 07:49:43.275361 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 184/323] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:49:43 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:49:43.895909 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f98885da-e96a-4f26-8176-e2ea05daed7f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:43.897592 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f98885da-e96a-4f26-8176-e2ea05daed7f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:43.904438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f98885da-e96a-4f26-8176-e2ea05daed7f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:43.904893 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f98885da-e96a-4f26-8176-e2ea05daed7f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:43.905685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f98885da-e96a-4f26-8176-e2ea05daed7f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:43.906123 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f98885da-e96a-4f26-8176-e2ea05daed7f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:43.956957 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-78aa830e-81f1-4c56-935c-9a750d09a27a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:43.957565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-78aa830e-81f1-4c56-935c-9a750d09a27a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:43.965031 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78aa830e-81f1-4c56-935c-9a750d09a27a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:43.965475 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78aa830e-81f1-4c56-935c-9a750d09a27a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:43.966268 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78aa830e-81f1-4c56-935c-9a750d09a27a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:43.966704 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78aa830e-81f1-4c56-935c-9a750d09a27a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:44.094553 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-78aa830e-81f1-4c56-935c-9a750d09a27a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:44.102606 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-78aa830e-81f1-4c56-935c-9a750d09a27a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:44.104110 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-78aa830e-81f1-4c56-935c-9a750d09a27a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:44.105207 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-78aa830e-81f1-4c56-935c-9a750d09a27a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.152122 Aug 30 07:49:44.105754 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 185/324] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:43 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:49:44.110051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ebb8c526-92d7-4ae3-9da1-5d56ae5538a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:44.110676 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ebb8c526-92d7-4ae3-9da1-5d56ae5538a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:44.117169 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ebb8c526-92d7-4ae3-9da1-5d56ae5538a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:44.117612 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ebb8c526-92d7-4ae3-9da1-5d56ae5538a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:44.118401 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ebb8c526-92d7-4ae3-9da1-5d56ae5538a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:44.118829 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ebb8c526-92d7-4ae3-9da1-5d56ae5538a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:44.167993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f98885da-e96a-4f26-8176-e2ea05daed7f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.275821 Aug 30 07:49:44.172095 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 140/325] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:43 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:44.250646 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ebb8c526-92d7-4ae3-9da1-5d56ae5538a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:44.258873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ebb8c526-92d7-4ae3-9da1-5d56ae5538a0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.152089 Aug 30 07:49:44.259443 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 186/326] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:44 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:44.287014 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b7c7700f-d2e7-40bf-9014-2067d0b06804 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:44.288113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b7c7700f-d2e7-40bf-9014-2067d0b06804 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:44.294675 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b7c7700f-d2e7-40bf-9014-2067d0b06804 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:44.295119 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b7c7700f-d2e7-40bf-9014-2067d0b06804 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:44.295885 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b7c7700f-d2e7-40bf-9014-2067d0b06804 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:44.296317 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b7c7700f-d2e7-40bf-9014-2067d0b06804 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:44.328674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b7c7700f-d2e7-40bf-9014-2067d0b06804 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Aug 30 07:49:44.329253 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 141/327] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:49:44 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:49:44.801525 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-670523358", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "networks": [{"uuid": "c4d33ed9-0946-4851-a2a3-23707dea7a5f"}]}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:44.854524 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.network.neutron [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] validate_networks() for [('c4d33ed9-0946-4851-a2a3-23707dea7a5f', None, None, None, None, None)] {{(pid=114671) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:49:45.123010 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7b6469db-c8b3-4f8e-998d-da08cd67017f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:45.123640 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7b6469db-c8b3-4f8e-998d-da08cd67017f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:45.131272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7b6469db-c8b3-4f8e-998d-da08cd67017f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:45.132538 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7b6469db-c8b3-4f8e-998d-da08cd67017f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:45.133541 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7b6469db-c8b3-4f8e-998d-da08cd67017f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:45.133793 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7b6469db-c8b3-4f8e-998d-da08cd67017f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:45.232716 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Flavor limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:49:45.233212 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Image limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:49:45.233597 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Flavor pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:49:45.234006 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Image pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:49:45.234445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:49:45.244788 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:45.245231 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:45.246039 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:45.246509 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:45.265038 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7b6469db-c8b3-4f8e-998d-da08cd67017f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:45.265324 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Getting quotas for project 8ef57d4aac6547848f525daced09f728. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:49:45.269477 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Getting quotas for user 7c7eed77389f443b9bad3cd1456a2bd8 and project 8ef57d4aac6547848f525daced09f728. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:49:45.273885 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7b6469db-c8b3-4f8e-998d-da08cd67017f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:45.275615 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7b6469db-c8b3-4f8e-998d-da08cd67017f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:45.277351 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7b6469db-c8b3-4f8e-998d-da08cd67017f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.158119 Aug 30 07:49:45.277949 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 142/328] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:45 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:49:45.282741 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0bdd34b5-ec78-4388-847a-7941eafb7d04 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:45.283749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0bdd34b5-ec78-4388-847a-7941eafb7d04 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:45.290500 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0bdd34b5-ec78-4388-847a-7941eafb7d04 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:45.291050 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0bdd34b5-ec78-4388-847a-7941eafb7d04 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:45.291898 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0bdd34b5-ec78-4388-847a-7941eafb7d04 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:45.292339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0bdd34b5-ec78-4388-847a-7941eafb7d04 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:45.294341 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Going to run 1 instances... {{(pid=114671) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:49:45.296652 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:49:45.343145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2ac125f1-0312-42e5-9ef2-c99d4f5ae727 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545236 Aug 30 07:49:45.343792 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 187/329] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:49:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:49:45.348141 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8389acf7-06f9-4aa4-9cce-e80048dd393a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:45.348917 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8389acf7-06f9-4aa4-9cce-e80048dd393a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:45.356804 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8389acf7-06f9-4aa4-9cce-e80048dd393a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:45.357256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8389acf7-06f9-4aa4-9cce-e80048dd393a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:45.358172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8389acf7-06f9-4aa4-9cce-e80048dd393a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:45.358629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8389acf7-06f9-4aa4-9cce-e80048dd393a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:45.360212 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0bdd34b5-ec78-4388-847a-7941eafb7d04 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.080919 Aug 30 07:49:45.361031 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 143/330] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:45 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:45.368350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-089a95b8-bbd7-4911-a9e9-7c656d530950 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:45.369414 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-089a95b8-bbd7-4911-a9e9-7c656d530950 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:45.376583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-089a95b8-bbd7-4911-a9e9-7c656d530950 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:45.377046 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-089a95b8-bbd7-4911-a9e9-7c656d530950 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:45.377832 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-089a95b8-bbd7-4911-a9e9-7c656d530950 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:45.378452 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-089a95b8-bbd7-4911-a9e9-7c656d530950 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:45.540364 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8389acf7-06f9-4aa4-9cce-e80048dd393a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:45.557616 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8389acf7-06f9-4aa4-9cce-e80048dd393a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.212759 Aug 30 07:49:45.558235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 188/331] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:45 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:45.573550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-72f03a60-993f-4e9b-ad5b-0805289cffdd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:45.574203 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-72f03a60-993f-4e9b-ad5b-0805289cffdd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:45.589235 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-089a95b8-bbd7-4911-a9e9-7c656d530950 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226496 Aug 30 07:49:45.590134 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 144/332] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:49:45 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:49:45.654493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-72f03a60-993f-4e9b-ad5b-0805289cffdd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:45.667850 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-72f03a60-993f-4e9b-ad5b-0805289cffdd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1213 microversion: 2.1 time: 0.108007 Aug 30 07:49:45.668820 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 189/333] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:45 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:46.296144 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2c66c675-f440-4536-96d1-14b3f5383fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:46.296776 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2c66c675-f440-4536-96d1-14b3f5383fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:46.303948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c66c675-f440-4536-96d1-14b3f5383fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:46.304263 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c66c675-f440-4536-96d1-14b3f5383fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:46.304956 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c66c675-f440-4536-96d1-14b3f5383fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:46.305391 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2c66c675-f440-4536-96d1-14b3f5383fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:46.373460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-33f7cf48-141c-4a2d-942a-9bcfaac192c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:46.374657 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-33f7cf48-141c-4a2d-942a-9bcfaac192c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:46.382605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-33f7cf48-141c-4a2d-942a-9bcfaac192c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:46.383259 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-33f7cf48-141c-4a2d-942a-9bcfaac192c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:46.384124 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-33f7cf48-141c-4a2d-942a-9bcfaac192c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:46.384653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-33f7cf48-141c-4a2d-942a-9bcfaac192c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:46.511656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2c66c675-f440-4536-96d1-14b3f5383fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:46.528922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2c66c675-f440-4536-96d1-14b3f5383fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:46.530750 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2c66c675-f440-4536-96d1-14b3f5383fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:46.532217 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2c66c675-f440-4536-96d1-14b3f5383fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.239904 Aug 30 07:49:46.533472 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 145/334] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:46 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:49:46.574797 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6048c49f-1d82-4ab7-9914-8cc5a40fdcfa tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:46.575405 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6048c49f-1d82-4ab7-9914-8cc5a40fdcfa tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:46.581776 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6048c49f-1d82-4ab7-9914-8cc5a40fdcfa tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:46.582269 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6048c49f-1d82-4ab7-9914-8cc5a40fdcfa tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:46.583309 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6048c49f-1d82-4ab7-9914-8cc5a40fdcfa tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:46.583785 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6048c49f-1d82-4ab7-9914-8cc5a40fdcfa tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:46.783411 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6048c49f-1d82-4ab7-9914-8cc5a40fdcfa tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:46.794487 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6048c49f-1d82-4ab7-9914-8cc5a40fdcfa tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.222872 Aug 30 07:49:46.795422 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 146/335] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:46 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:46.803557 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e41e95f6-b354-44fc-8c3a-607c58db3674 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:46.805279 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e41e95f6-b354-44fc-8c3a-607c58db3674 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:46.816097 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e41e95f6-b354-44fc-8c3a-607c58db3674 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:46.816751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e41e95f6-b354-44fc-8c3a-607c58db3674 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:46.817559 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e41e95f6-b354-44fc-8c3a-607c58db3674 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:46.818030 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e41e95f6-b354-44fc-8c3a-607c58db3674 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:46.833516 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-33f7cf48-141c-4a2d-942a-9bcfaac192c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.464014 Aug 30 07:49:46.835376 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 190/336] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:46 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:49:46.841107 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-df65e383-d2cb-45c9-83d7-2aba1c95a901 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:46.841862 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-df65e383-d2cb-45c9-83d7-2aba1c95a901 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:46.848649 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df65e383-d2cb-45c9-83d7-2aba1c95a901 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:46.849492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df65e383-d2cb-45c9-83d7-2aba1c95a901 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:46.850409 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df65e383-d2cb-45c9-83d7-2aba1c95a901 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:46.850846 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df65e383-d2cb-45c9-83d7-2aba1c95a901 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:46.854623 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e41e95f6-b354-44fc-8c3a-607c58db3674 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057736 Aug 30 07:49:46.855509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 147/337] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:49:46 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:49:46.936539 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-df65e383-d2cb-45c9-83d7-2aba1c95a901 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:46.956884 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-df65e383-d2cb-45c9-83d7-2aba1c95a901 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1271 microversion: 2.1 time: 0.120260 Aug 30 07:49:46.958053 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 191/338] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:46 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:47.087738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1562404393", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "networks": [{"uuid": "48af5f56-a712-424c-ad52-bbe266bf5358"}]}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:47.141788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] validate_networks() for [('48af5f56-a712-424c-ad52-bbe266bf5358', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:49:47.552757 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2dc39c02-dbc6-4eda-b29c-1ec9b6231982 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:47.554305 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2dc39c02-dbc6-4eda-b29c-1ec9b6231982 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:47.561625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2dc39c02-dbc6-4eda-b29c-1ec9b6231982 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:47.562209 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2dc39c02-dbc6-4eda-b29c-1ec9b6231982 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:47.563381 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2dc39c02-dbc6-4eda-b29c-1ec9b6231982 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:47.563899 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2dc39c02-dbc6-4eda-b29c-1ec9b6231982 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:47.698824 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2dc39c02-dbc6-4eda-b29c-1ec9b6231982 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:47.707122 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2dc39c02-dbc6-4eda-b29c-1ec9b6231982 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:47.708852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2dc39c02-dbc6-4eda-b29c-1ec9b6231982 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:47.710142 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2dc39c02-dbc6-4eda-b29c-1ec9b6231982 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.161317 Aug 30 07:49:47.710998 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 192/339] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:47 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:49:47.813072 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-618ff299-5d3d-41d8-a542-442b3cae8620 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:47.813945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-618ff299-5d3d-41d8-a542-442b3cae8620 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:47.820494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-618ff299-5d3d-41d8-a542-442b3cae8620 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:47.820945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-618ff299-5d3d-41d8-a542-442b3cae8620 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:47.821735 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-618ff299-5d3d-41d8-a542-442b3cae8620 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:47.822338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-618ff299-5d3d-41d8-a542-442b3cae8620 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:47.853770 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:49:47.854274 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:49:47.854684 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:49:47.855100 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:49:47.855515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:49:47.864689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:47.865166 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:47.866074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:47.866732 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:47.886102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Getting quotas for project b7540de7f257475e864b4023460d355a. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:49:47.892684 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Getting quotas for user 93170b4e61c9470ba9b7ec6bb66e86e0 and project b7540de7f257475e864b4023460d355a. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:49:47.910536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:49:47.913705 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:49:47.971414 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-618ff299-5d3d-41d8-a542-442b3cae8620 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:47.976575 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bd8b6f55-2f38-4e94-b196-9e613f3aaed3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891404 Aug 30 07:49:47.977255 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 148/340] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:49:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:49:47.983597 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-da67078e-647c-411f-bffd-864f2d39d764 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:47.984635 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-da67078e-647c-411f-bffd-864f2d39d764 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:48.000088 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-da67078e-647c-411f-bffd-864f2d39d764 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:48.000544 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-da67078e-647c-411f-bffd-864f2d39d764 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:48.001395 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-da67078e-647c-411f-bffd-864f2d39d764 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:48.002044 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-da67078e-647c-411f-bffd-864f2d39d764 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:48.006291 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-618ff299-5d3d-41d8-a542-442b3cae8620 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.197444 Aug 30 07:49:48.007464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 193/341] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:47 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:48.022549 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-11f5a277-1900-43fe-b72f-1884d3d66997 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:48.023319 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-11f5a277-1900-43fe-b72f-1884d3d66997 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:48.040485 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-11f5a277-1900-43fe-b72f-1884d3d66997 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:48.041137 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-11f5a277-1900-43fe-b72f-1884d3d66997 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:48.041907 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-11f5a277-1900-43fe-b72f-1884d3d66997 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:48.044384 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-11f5a277-1900-43fe-b72f-1884d3d66997 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:48.186459 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-da67078e-647c-411f-bffd-864f2d39d764 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.207282 Aug 30 07:49:48.188156 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 149/342] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:47 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:48.200829 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0457ab12-ac35-4e0c-b57e-f750faecd021 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:48.203100 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0457ab12-ac35-4e0c-b57e-f750faecd021 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:48.243975 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-11f5a277-1900-43fe-b72f-1884d3d66997 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:48.252317 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-11f5a277-1900-43fe-b72f-1884d3d66997 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.243545 Aug 30 07:49:48.253229 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 194/343] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:48 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:48.308158 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0457ab12-ac35-4e0c-b57e-f750faecd021 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:48.316307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0457ab12-ac35-4e0c-b57e-f750faecd021 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1218 microversion: 2.1 time: 0.126292 Aug 30 07:49:48.316955 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 150/344] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:48 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:48.619071 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-4898cf01-4f9b-47f0-81f4-8dea1f60b208 req-1491397c-f3ed-4136-9415-9ba9ed83e1ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4452d5f-87e6-4c7e-9d92-71d489324d18", "tag": "0c1fdca9-6459-41de-9778-c72124cf39a8"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:48.620980 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:49:48.620980 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:49:48.630792 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-4898cf01-4f9b-47f0-81f4-8dea1f60b208 req-1491397c-f3ed-4136-9415-9ba9ed83e1ec service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:48.631472 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-4898cf01-4f9b-47f0-81f4-8dea1f60b208 req-1491397c-f3ed-4136-9415-9ba9ed83e1ec service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:48.643186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-4898cf01-4f9b-47f0-81f4-8dea1f60b208 req-1491397c-f3ed-4136-9415-9ba9ed83e1ec service nova] Creating event network-changed:0c1fdca9-6459-41de-9778-c72124cf39a8 for instance a4452d5f-87e6-4c7e-9d92-71d489324d18 on hv-cinder-80619 Aug 30 07:49:48.649480 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-4898cf01-4f9b-47f0-81f4-8dea1f60b208 req-1491397c-f3ed-4136-9415-9ba9ed83e1ec service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034341 Aug 30 07:49:48.650764 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 195/345] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:49:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:49:48.729139 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2e4efdc3-0d38-4fb8-8432-a3868a0587e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:48.729929 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2e4efdc3-0d38-4fb8-8432-a3868a0587e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:48.736477 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2e4efdc3-0d38-4fb8-8432-a3868a0587e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:48.736953 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2e4efdc3-0d38-4fb8-8432-a3868a0587e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:48.737798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2e4efdc3-0d38-4fb8-8432-a3868a0587e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:48.738362 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2e4efdc3-0d38-4fb8-8432-a3868a0587e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:48.933648 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2e4efdc3-0d38-4fb8-8432-a3868a0587e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:48.942157 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2e4efdc3-0d38-4fb8-8432-a3868a0587e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:48.944267 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2e4efdc3-0d38-4fb8-8432-a3868a0587e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:48.945375 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2e4efdc3-0d38-4fb8-8432-a3868a0587e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.221195 Aug 30 07:49:48.946285 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 151/346] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:48 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:49:49.024624 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f47b2dbe-319a-422d-843a-047131c48dc3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:49.025363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f47b2dbe-319a-422d-843a-047131c48dc3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:49.032291 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f47b2dbe-319a-422d-843a-047131c48dc3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:49.032730 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f47b2dbe-319a-422d-843a-047131c48dc3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:49.033507 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f47b2dbe-319a-422d-843a-047131c48dc3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:49.033935 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f47b2dbe-319a-422d-843a-047131c48dc3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:49.176436 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f47b2dbe-319a-422d-843a-047131c48dc3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:49.191053 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f47b2dbe-319a-422d-843a-047131c48dc3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.171216 Aug 30 07:49:49.192367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 196/347] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:49 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:49.205090 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3523efb5-462c-49eb-8c49-0258f9dd70f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:49.206536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3523efb5-462c-49eb-8c49-0258f9dd70f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:49.214345 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3523efb5-462c-49eb-8c49-0258f9dd70f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:49.214873 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3523efb5-462c-49eb-8c49-0258f9dd70f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:49.215739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3523efb5-462c-49eb-8c49-0258f9dd70f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:49.216397 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3523efb5-462c-49eb-8c49-0258f9dd70f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:49.276293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a555317a-24ce-4f3d-9656-30c256cf7306 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:49.277979 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a555317a-24ce-4f3d-9656-30c256cf7306 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:49.288612 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a555317a-24ce-4f3d-9656-30c256cf7306 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:49.289414 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a555317a-24ce-4f3d-9656-30c256cf7306 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:49.290844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a555317a-24ce-4f3d-9656-30c256cf7306 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:49.291630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a555317a-24ce-4f3d-9656-30c256cf7306 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:49.397540 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3523efb5-462c-49eb-8c49-0258f9dd70f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.200511 Aug 30 07:49:49.398407 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 152/348] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:49 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:49.407392 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5f8f24a1-9e2e-4f9f-aa6d-01501581ae9b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:49.408766 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5f8f24a1-9e2e-4f9f-aa6d-01501581ae9b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:49.419423 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f8f24a1-9e2e-4f9f-aa6d-01501581ae9b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:49.420219 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f8f24a1-9e2e-4f9f-aa6d-01501581ae9b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:49.421156 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f8f24a1-9e2e-4f9f-aa6d-01501581ae9b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:49.421722 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f8f24a1-9e2e-4f9f-aa6d-01501581ae9b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:49.430976 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a555317a-24ce-4f3d-9656-30c256cf7306 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:49.441941 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a555317a-24ce-4f3d-9656-30c256cf7306 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.174080 Aug 30 07:49:49.442548 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 197/349] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:49 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:49.511829 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5f8f24a1-9e2e-4f9f-aa6d-01501581ae9b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:49.522897 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5f8f24a1-9e2e-4f9f-aa6d-01501581ae9b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1270 microversion: 2.1 time: 0.122010 Aug 30 07:49:49.523514 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 153/350] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:49 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:49.963224 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f4926a63-ce24-4966-903f-c5f28730eeab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:49.964524 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f4926a63-ce24-4966-903f-c5f28730eeab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:49.971329 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f4926a63-ce24-4966-903f-c5f28730eeab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:49.971778 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f4926a63-ce24-4966-903f-c5f28730eeab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:49.972546 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f4926a63-ce24-4966-903f-c5f28730eeab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:49.972977 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f4926a63-ce24-4966-903f-c5f28730eeab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:50.110283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f4926a63-ce24-4966-903f-c5f28730eeab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:50.118780 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f4926a63-ce24-4966-903f-c5f28730eeab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:50.120308 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f4926a63-ce24-4966-903f-c5f28730eeab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:50.121429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f4926a63-ce24-4966-903f-c5f28730eeab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.162202 Aug 30 07:49:50.122181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 198/351] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:49 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:49:50.208773 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-92b85335-9a62-43d2-ae0c-6795b9d1abbd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:50.209991 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-92b85335-9a62-43d2-ae0c-6795b9d1abbd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:50.216186 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92b85335-9a62-43d2-ae0c-6795b9d1abbd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:50.216635 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92b85335-9a62-43d2-ae0c-6795b9d1abbd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:50.217405 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92b85335-9a62-43d2-ae0c-6795b9d1abbd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:50.217834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92b85335-9a62-43d2-ae0c-6795b9d1abbd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:50.349537 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-92b85335-9a62-43d2-ae0c-6795b9d1abbd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:50.357807 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-92b85335-9a62-43d2-ae0c-6795b9d1abbd tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1522 microversion: 2.1 time: 0.152737 Aug 30 07:49:50.358476 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 154/352] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:50 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:50.413461 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-73f08c56-ebb6-47f0-b765-02086862cd86 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:50.414478 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-73f08c56-ebb6-47f0-b765-02086862cd86 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:50.420509 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-73f08c56-ebb6-47f0-b765-02086862cd86 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:50.420962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-73f08c56-ebb6-47f0-b765-02086862cd86 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:50.421727 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-73f08c56-ebb6-47f0-b765-02086862cd86 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:50.422178 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-73f08c56-ebb6-47f0-b765-02086862cd86 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:50.461968 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b0c33655-fe36-4069-abbe-fd7da59ac5ce tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:50.462530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b0c33655-fe36-4069-abbe-fd7da59ac5ce tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:50.468914 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0c33655-fe36-4069-abbe-fd7da59ac5ce tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:50.469359 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0c33655-fe36-4069-abbe-fd7da59ac5ce tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:50.470130 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0c33655-fe36-4069-abbe-fd7da59ac5ce tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:50.470582 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0c33655-fe36-4069-abbe-fd7da59ac5ce tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:50.602794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b0c33655-fe36-4069-abbe-fd7da59ac5ce tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:50.610382 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b0c33655-fe36-4069-abbe-fd7da59ac5ce tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.153104 Aug 30 07:49:50.610954 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 155/353] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:50 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:50.615190 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6ae514e5-cb5b-4f5e-8b66-587dac8c2aef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:50.615878 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6ae514e5-cb5b-4f5e-8b66-587dac8c2aef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:50.621982 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6ae514e5-cb5b-4f5e-8b66-587dac8c2aef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:50.622475 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6ae514e5-cb5b-4f5e-8b66-587dac8c2aef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:50.623247 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6ae514e5-cb5b-4f5e-8b66-587dac8c2aef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:50.623685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6ae514e5-cb5b-4f5e-8b66-587dac8c2aef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:50.685530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6ae514e5-cb5b-4f5e-8b66-587dac8c2aef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:50.694964 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6ae514e5-cb5b-4f5e-8b66-587dac8c2aef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1270 microversion: 2.1 time: 0.082959 Aug 30 07:49:50.695538 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 156/354] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:50 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:50.724326 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-73f08c56-ebb6-47f0-b765-02086862cd86 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.314870 Aug 30 07:49:50.725201 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 199/355] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:50 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:51.139389 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-abd5c568-5104-4790-a1e8-b62512dba62d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:51.140011 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-abd5c568-5104-4790-a1e8-b62512dba62d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:51.145928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-abd5c568-5104-4790-a1e8-b62512dba62d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.146936 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-abd5c568-5104-4790-a1e8-b62512dba62d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.147833 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-abd5c568-5104-4790-a1e8-b62512dba62d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.148234 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-abd5c568-5104-4790-a1e8-b62512dba62d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.375826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ef6c13ad-8583-4ed2-9624-5811fa5ea0b0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:51.377382 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ef6c13ad-8583-4ed2-9624-5811fa5ea0b0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:51.378769 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-abd5c568-5104-4790-a1e8-b62512dba62d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:51.387262 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ef6c13ad-8583-4ed2-9624-5811fa5ea0b0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.388015 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ef6c13ad-8583-4ed2-9624-5811fa5ea0b0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.388317 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-abd5c568-5104-4790-a1e8-b62512dba62d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:51.388812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ef6c13ad-8583-4ed2-9624-5811fa5ea0b0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.389252 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ef6c13ad-8583-4ed2-9624-5811fa5ea0b0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.390384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-abd5c568-5104-4790-a1e8-b62512dba62d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:51.391604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-abd5c568-5104-4790-a1e8-b62512dba62d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.255984 Aug 30 07:49:51.392378 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 157/356] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:51 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:49:51.539038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ef6c13ad-8583-4ed2-9624-5811fa5ea0b0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:51.546662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ef6c13ad-8583-4ed2-9624-5811fa5ea0b0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1502 microversion: 2.1 time: 0.175335 Aug 30 07:49:51.547256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 200/357] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:51 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:51.569496 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5cbba43b-7a2e-4f52-80da-2e9cc3d91695 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:51.572341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5cbba43b-7a2e-4f52-80da-2e9cc3d91695 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:51.579476 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cbba43b-7a2e-4f52-80da-2e9cc3d91695 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.579927 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cbba43b-7a2e-4f52-80da-2e9cc3d91695 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.580704 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cbba43b-7a2e-4f52-80da-2e9cc3d91695 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.581139 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cbba43b-7a2e-4f52-80da-2e9cc3d91695 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.628088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d241f69e-23e9-4334-a08b-11316819cdb1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:51.628088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d241f69e-23e9-4334-a08b-11316819cdb1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:51.636662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d241f69e-23e9-4334-a08b-11316819cdb1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.637604 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d241f69e-23e9-4334-a08b-11316819cdb1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.639164 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d241f69e-23e9-4334-a08b-11316819cdb1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.639725 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d241f69e-23e9-4334-a08b-11316819cdb1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.803605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d241f69e-23e9-4334-a08b-11316819cdb1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:51.814677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d241f69e-23e9-4334-a08b-11316819cdb1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.190606 Aug 30 07:49:51.816211 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 201/358] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:51 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:51.823284 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d90fe956-aae3-48b1-aa88-257cb00f0572 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:51.824114 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d90fe956-aae3-48b1-aa88-257cb00f0572 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:51.830909 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d90fe956-aae3-48b1-aa88-257cb00f0572 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.831504 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d90fe956-aae3-48b1-aa88-257cb00f0572 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.832732 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d90fe956-aae3-48b1-aa88-257cb00f0572 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.833426 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d90fe956-aae3-48b1-aa88-257cb00f0572 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.863611 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5cbba43b-7a2e-4f52-80da-2e9cc3d91695 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:51.873605 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5cbba43b-7a2e-4f52-80da-2e9cc3d91695 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1516 microversion: 2.1 time: 0.311182 Aug 30 07:49:51.874494 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 158/359] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:51 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:51.889664 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d9918a72-9e1d-4ff2-9b65-baf84c9cc3fb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:51.891095 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d9918a72-9e1d-4ff2-9b65-baf84c9cc3fb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:51.900571 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9918a72-9e1d-4ff2-9b65-baf84c9cc3fb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.901487 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9918a72-9e1d-4ff2-9b65-baf84c9cc3fb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.902573 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9918a72-9e1d-4ff2-9b65-baf84c9cc3fb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:51.903172 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9918a72-9e1d-4ff2-9b65-baf84c9cc3fb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:51.998722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d90fe956-aae3-48b1-aa88-257cb00f0572 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:52.007974 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d90fe956-aae3-48b1-aa88-257cb00f0572 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.189731 Aug 30 07:49:52.008835 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 202/360] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:51 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:52.272522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d9918a72-9e1d-4ff2-9b65-baf84c9cc3fb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.389414 Aug 30 07:49:52.273717 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 159/361] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:51 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:52.338680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-c3b2e0ca-f156-4c18-b5b6-414a7f6c7332 req-f131b3e3-c566-42d1-a319-b977fc48cd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f", "name": "network-vif-plugged", "status": "completed", "tag": "32f744e1-43b5-4cbe-a3b6-9ee81f793879"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:52.340672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:49:52.340672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:49:52.349526 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-c3b2e0ca-f156-4c18-b5b6-414a7f6c7332 req-f131b3e3-c566-42d1-a319-b977fc48cd3f service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:52.350304 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-c3b2e0ca-f156-4c18-b5b6-414a7f6c7332 req-f131b3e3-c566-42d1-a319-b977fc48cd3f service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:52.364577 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-c3b2e0ca-f156-4c18-b5b6-414a7f6c7332 req-f131b3e3-c566-42d1-a319-b977fc48cd3f service nova] Creating event network-vif-plugged:32f744e1-43b5-4cbe-a3b6-9ee81f793879 for instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f on hv-cinder-80619 Aug 30 07:49:52.371002 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-c3b2e0ca-f156-4c18-b5b6-414a7f6c7332 req-f131b3e3-c566-42d1-a319-b977fc48cd3f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036041 Aug 30 07:49:52.372166 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 203/362] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:49:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:49:52.420922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b8e44fe9-35c5-4220-8827-896686afee5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:52.424186 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b8e44fe9-35c5-4220-8827-896686afee5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:52.439443 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8e44fe9-35c5-4220-8827-896686afee5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:52.439886 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8e44fe9-35c5-4220-8827-896686afee5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:52.440763 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8e44fe9-35c5-4220-8827-896686afee5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:52.441103 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8e44fe9-35c5-4220-8827-896686afee5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:52.808117 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b8e44fe9-35c5-4220-8827-896686afee5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:52.816376 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b8e44fe9-35c5-4220-8827-896686afee5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:52.818014 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b8e44fe9-35c5-4220-8827-896686afee5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:52.819614 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b8e44fe9-35c5-4220-8827-896686afee5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.402862 Aug 30 07:49:52.820466 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 160/363] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:52 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:49:52.835024 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3fdf2690-f536-4731-876d-c70e560335c1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:52.835868 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3fdf2690-f536-4731-876d-c70e560335c1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:52.845329 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3fdf2690-f536-4731-876d-c70e560335c1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:52.846020 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3fdf2690-f536-4731-876d-c70e560335c1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:52.846888 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3fdf2690-f536-4731-876d-c70e560335c1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:52.847333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3fdf2690-f536-4731-876d-c70e560335c1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:52.987625 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-24a2cf5a-2cb7-4321-832f-b5f1c9c02f26 req-629d69c7-8e02-4845-af71-22335021cdf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b32f1264-9680-449b-a1eb-c42ea5401715", "tag": "ed47d797-7cde-4038-9cf6-19c7781b0f13"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:52.989807 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:49:52.989807 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:49:52.997940 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-24a2cf5a-2cb7-4321-832f-b5f1c9c02f26 req-629d69c7-8e02-4845-af71-22335021cdf6 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:52.998428 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-24a2cf5a-2cb7-4321-832f-b5f1c9c02f26 req-629d69c7-8e02-4845-af71-22335021cdf6 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:53.011545 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-24a2cf5a-2cb7-4321-832f-b5f1c9c02f26 req-629d69c7-8e02-4845-af71-22335021cdf6 service nova] Creating event network-changed:ed47d797-7cde-4038-9cf6-19c7781b0f13 for instance b32f1264-9680-449b-a1eb-c42ea5401715 on hv-cinder-80619 Aug 30 07:49:53.014086 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3fdf2690-f536-4731-876d-c70e560335c1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:53.016553 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-24a2cf5a-2cb7-4321-832f-b5f1c9c02f26 req-629d69c7-8e02-4845-af71-22335021cdf6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032568 Aug 30 07:49:53.017156 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 161/364] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:49:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:49:53.024646 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3fdf2690-f536-4731-876d-c70e560335c1 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.194840 Aug 30 07:49:53.025229 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 204/365] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:52 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:53.033886 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f3cb8a3f-1133-4d42-a65e-b1303df7a5f2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:53.033886 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f3cb8a3f-1133-4d42-a65e-b1303df7a5f2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:53.037070 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f3cb8a3f-1133-4d42-a65e-b1303df7a5f2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:53.037793 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f3cb8a3f-1133-4d42-a65e-b1303df7a5f2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:53.038317 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f3cb8a3f-1133-4d42-a65e-b1303df7a5f2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:53.038763 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f3cb8a3f-1133-4d42-a65e-b1303df7a5f2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:53.169973 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f3cb8a3f-1133-4d42-a65e-b1303df7a5f2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:53.178591 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f3cb8a3f-1133-4d42-a65e-b1303df7a5f2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.152134 Aug 30 07:49:53.179172 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 162/366] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:53 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:53.287995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bb526a9c-46d4-46bb-9fd2-976e6955036c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:53.287995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bb526a9c-46d4-46bb-9fd2-976e6955036c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:53.293554 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bb526a9c-46d4-46bb-9fd2-976e6955036c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:53.294005 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bb526a9c-46d4-46bb-9fd2-976e6955036c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:53.294817 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bb526a9c-46d4-46bb-9fd2-976e6955036c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:53.295320 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bb526a9c-46d4-46bb-9fd2-976e6955036c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:53.542840 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bb526a9c-46d4-46bb-9fd2-976e6955036c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.259539 Aug 30 07:49:53.545844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 205/367] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:53 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:53.838587 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-41808766-7329-417e-a24a-8bbed3035924 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:53.839201 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-41808766-7329-417e-a24a-8bbed3035924 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:53.845381 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41808766-7329-417e-a24a-8bbed3035924 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:53.845831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41808766-7329-417e-a24a-8bbed3035924 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:53.846662 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41808766-7329-417e-a24a-8bbed3035924 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:53.847092 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41808766-7329-417e-a24a-8bbed3035924 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:54.043283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-eac4fa33-492f-4fd4-8cb1-15ce34136b1b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:54.043989 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-eac4fa33-492f-4fd4-8cb1-15ce34136b1b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:54.050548 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eac4fa33-492f-4fd4-8cb1-15ce34136b1b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:54.050999 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eac4fa33-492f-4fd4-8cb1-15ce34136b1b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:54.051779 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eac4fa33-492f-4fd4-8cb1-15ce34136b1b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:54.052287 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eac4fa33-492f-4fd4-8cb1-15ce34136b1b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:54.168075 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-41808766-7329-417e-a24a-8bbed3035924 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:54.181479 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-41808766-7329-417e-a24a-8bbed3035924 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:54.183111 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-eac4fa33-492f-4fd4-8cb1-15ce34136b1b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:54.183478 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-41808766-7329-417e-a24a-8bbed3035924 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:54.185786 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-41808766-7329-417e-a24a-8bbed3035924 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.350688 Aug 30 07:49:54.187586 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 163/368] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:53 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:49:54.194562 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-eac4fa33-492f-4fd4-8cb1-15ce34136b1b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.156909 Aug 30 07:49:54.195535 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 206/369] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:54 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:54.197750 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-84d726e7-50b9-4e87-ba99-39b3d642a10e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:54.202182 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-84d726e7-50b9-4e87-ba99-39b3d642a10e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:54.205124 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-84d726e7-50b9-4e87-ba99-39b3d642a10e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:54.205641 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-84d726e7-50b9-4e87-ba99-39b3d642a10e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:54.206556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-84d726e7-50b9-4e87-ba99-39b3d642a10e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:54.207057 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-84d726e7-50b9-4e87-ba99-39b3d642a10e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:54.387004 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a33cc4e6-5575-48dd-8cd6-58522896692c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:54.387962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a33cc4e6-5575-48dd-8cd6-58522896692c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:54.394705 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a33cc4e6-5575-48dd-8cd6-58522896692c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:54.395157 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a33cc4e6-5575-48dd-8cd6-58522896692c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:54.395942 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a33cc4e6-5575-48dd-8cd6-58522896692c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:54.396963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a33cc4e6-5575-48dd-8cd6-58522896692c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:54.421738 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-a33cc4e6-5575-48dd-8cd6-58522896692c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lazy-loading 'flavor' on Instance uuid 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:49:54.496242 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a33cc4e6-5575-48dd-8cd6-58522896692c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/action" status: 200 len: 32 microversion: 2.1 time: 0.112978 Aug 30 07:49:54.500831 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 207/370] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:54 2021] POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/action => generated 32 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 07:49:54.507373 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0d5e4c07-92f3-4f70-b638-6ee4d7274f50 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:54.508085 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0d5e4c07-92f3-4f70-b638-6ee4d7274f50 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:54.514727 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d5e4c07-92f3-4f70-b638-6ee4d7274f50 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:54.514727 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d5e4c07-92f3-4f70-b638-6ee4d7274f50 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:54.516003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d5e4c07-92f3-4f70-b638-6ee4d7274f50 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:54.516119 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d5e4c07-92f3-4f70-b638-6ee4d7274f50 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:54.547236 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-84d726e7-50b9-4e87-ba99-39b3d642a10e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:54.559110 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-84d726e7-50b9-4e87-ba99-39b3d642a10e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.366860 Aug 30 07:49:54.574369 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 164/371] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:54 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:54.581195 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5b330858-f19e-4bb2-9516-8d43bfac382b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:54.582366 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5b330858-f19e-4bb2-9516-8d43bfac382b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:54.589312 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b330858-f19e-4bb2-9516-8d43bfac382b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:54.589941 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b330858-f19e-4bb2-9516-8d43bfac382b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:54.590593 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b330858-f19e-4bb2-9516-8d43bfac382b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:54.591379 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b330858-f19e-4bb2-9516-8d43bfac382b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:54.750938 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0d5e4c07-92f3-4f70-b638-6ee4d7274f50 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:54.759931 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0d5e4c07-92f3-4f70-b638-6ee4d7274f50 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.257840 Aug 30 07:49:54.760713 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 208/372] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:54 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:55.046325 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5b330858-f19e-4bb2-9516-8d43bfac382b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.470057 Aug 30 07:49:55.046981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 165/373] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:54 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:55.204322 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0980a6bb-d71f-4c22-ac87-c46289aca7e9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:55.205064 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0980a6bb-d71f-4c22-ac87-c46289aca7e9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:55.214046 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0980a6bb-d71f-4c22-ac87-c46289aca7e9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:55.216010 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0980a6bb-d71f-4c22-ac87-c46289aca7e9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:55.216010 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0980a6bb-d71f-4c22-ac87-c46289aca7e9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:55.216010 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0980a6bb-d71f-4c22-ac87-c46289aca7e9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:55.221375 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e07b61dd-a97a-4509-b98e-c1bc6c95a2ff tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:55.222534 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e07b61dd-a97a-4509-b98e-c1bc6c95a2ff tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:55.230772 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e07b61dd-a97a-4509-b98e-c1bc6c95a2ff tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:55.231328 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e07b61dd-a97a-4509-b98e-c1bc6c95a2ff tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:55.232543 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e07b61dd-a97a-4509-b98e-c1bc6c95a2ff tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:55.233084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e07b61dd-a97a-4509-b98e-c1bc6c95a2ff tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:55.367825 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e07b61dd-a97a-4509-b98e-c1bc6c95a2ff tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:55.371297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0980a6bb-d71f-4c22-ac87-c46289aca7e9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:55.375857 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e07b61dd-a97a-4509-b98e-c1bc6c95a2ff tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.158296 Aug 30 07:49:55.376444 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 166/374] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:55 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:55.380185 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0980a6bb-d71f-4c22-ac87-c46289aca7e9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:55.381817 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0980a6bb-d71f-4c22-ac87-c46289aca7e9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:55.383029 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0980a6bb-d71f-4c22-ac87-c46289aca7e9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1406 microversion: 2.20 time: 0.182493 Aug 30 07:49:55.383668 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 209/375] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:55 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:49:55.582866 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a321f47f-0cd9-4c10-a367-e8532b7f19c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:55.583475 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a321f47f-0cd9-4c10-a367-e8532b7f19c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:55.589892 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a321f47f-0cd9-4c10-a367-e8532b7f19c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:55.590376 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a321f47f-0cd9-4c10-a367-e8532b7f19c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:55.591139 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a321f47f-0cd9-4c10-a367-e8532b7f19c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:55.591566 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a321f47f-0cd9-4c10-a367-e8532b7f19c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:55.715223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a321f47f-0cd9-4c10-a367-e8532b7f19c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:55.722426 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a321f47f-0cd9-4c10-a367-e8532b7f19c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.143105 Aug 30 07:49:55.722998 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 167/376] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:55 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:55.777362 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2e34300b-eb9b-44c6-bcbc-aca031935c51 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:55.777975 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2e34300b-eb9b-44c6-bcbc-aca031935c51 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:55.783929 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e34300b-eb9b-44c6-bcbc-aca031935c51 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:55.784378 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e34300b-eb9b-44c6-bcbc-aca031935c51 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:55.785143 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e34300b-eb9b-44c6-bcbc-aca031935c51 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:55.785571 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e34300b-eb9b-44c6-bcbc-aca031935c51 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:55.914363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2e34300b-eb9b-44c6-bcbc-aca031935c51 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:55.921835 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2e34300b-eb9b-44c6-bcbc-aca031935c51 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.148107 Aug 30 07:49:55.922590 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 210/377] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:55 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:56.059143 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e4276ca4-b69d-4efc-8364-6ac4ac5d0662 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:56.060154 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e4276ca4-b69d-4efc-8364-6ac4ac5d0662 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:56.066587 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4276ca4-b69d-4efc-8364-6ac4ac5d0662 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.067331 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4276ca4-b69d-4efc-8364-6ac4ac5d0662 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:56.068741 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4276ca4-b69d-4efc-8364-6ac4ac5d0662 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.069629 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4276ca4-b69d-4efc-8364-6ac4ac5d0662 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:56.213302 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e4276ca4-b69d-4efc-8364-6ac4ac5d0662 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.158453 Aug 30 07:49:56.214230 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 168/378] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:56 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:49:56.397198 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b61c0598-e9d4-4306-9551-781b366e1a20 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:56.397974 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b61c0598-e9d4-4306-9551-781b366e1a20 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:56.402056 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-785304a3-37e9-4a43-bd23-724dc81937cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:56.402802 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-785304a3-37e9-4a43-bd23-724dc81937cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:56.404293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b61c0598-e9d4-4306-9551-781b366e1a20 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.404941 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b61c0598-e9d4-4306-9551-781b366e1a20 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:56.405717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b61c0598-e9d4-4306-9551-781b366e1a20 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.406420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b61c0598-e9d4-4306-9551-781b366e1a20 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:56.409416 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-785304a3-37e9-4a43-bd23-724dc81937cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.409939 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-785304a3-37e9-4a43-bd23-724dc81937cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:56.410833 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-785304a3-37e9-4a43-bd23-724dc81937cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.411268 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-785304a3-37e9-4a43-bd23-724dc81937cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:56.540767 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-785304a3-37e9-4a43-bd23-724dc81937cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:56.541313 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b61c0598-e9d4-4306-9551-781b366e1a20 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:56.548814 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-785304a3-37e9-4a43-bd23-724dc81937cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:56.549022 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b61c0598-e9d4-4306-9551-781b366e1a20 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.156308 Aug 30 07:49:56.550336 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 211/379] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:56 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:56.550572 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-785304a3-37e9-4a43-bd23-724dc81937cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:56.551472 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-785304a3-37e9-4a43-bd23-724dc81937cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1597 microversion: 2.20 time: 0.153519 Aug 30 07:49:56.552011 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 169/380] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:49:56 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:49:56.570511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0c406f8c-58ea-4395-8276-6a689a83b61d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:56.571760 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0c406f8c-58ea-4395-8276-6a689a83b61d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:56.577494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0c406f8c-58ea-4395-8276-6a689a83b61d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.577944 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0c406f8c-58ea-4395-8276-6a689a83b61d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:56.578828 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0c406f8c-58ea-4395-8276-6a689a83b61d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.579186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0c406f8c-58ea-4395-8276-6a689a83b61d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:56.667413 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0c406f8c-58ea-4395-8276-6a689a83b61d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101714 Aug 30 07:49:56.667970 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 212/381] 10.222.0.73 () {60 vars in 1316 bytes} [Mon Aug 30 07:49:56 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:56.739568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8df55657-d264-4087-ae95-9af244eb0b6c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:56.740834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8df55657-d264-4087-ae95-9af244eb0b6c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:56.746644 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8df55657-d264-4087-ae95-9af244eb0b6c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.747094 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8df55657-d264-4087-ae95-9af244eb0b6c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:56.747861 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8df55657-d264-4087-ae95-9af244eb0b6c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.748295 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8df55657-d264-4087-ae95-9af244eb0b6c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:56.874522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8df55657-d264-4087-ae95-9af244eb0b6c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:56.882506 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8df55657-d264-4087-ae95-9af244eb0b6c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.146530 Aug 30 07:49:56.883101 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 170/382] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:56 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:56.938312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-26b913c0-5551-4698-96a5-ed92a364946e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:56.938831 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-26b913c0-5551-4698-96a5-ed92a364946e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:56.945044 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-26b913c0-5551-4698-96a5-ed92a364946e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.945489 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-26b913c0-5551-4698-96a5-ed92a364946e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:56.946425 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-26b913c0-5551-4698-96a5-ed92a364946e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:56.946719 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-26b913c0-5551-4698-96a5-ed92a364946e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:57.211717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-26b913c0-5551-4698-96a5-ed92a364946e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:57.219523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-26b913c0-5551-4698-96a5-ed92a364946e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.284991 Aug 30 07:49:57.220561 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 213/383] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:56 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:57.225252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-36a32066-9858-49b8-bc57-511bac31d3ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:57.226824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-36a32066-9858-49b8-bc57-511bac31d3ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:57.233213 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-36a32066-9858-49b8-bc57-511bac31d3ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:57.233737 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-36a32066-9858-49b8-bc57-511bac31d3ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:57.234662 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-36a32066-9858-49b8-bc57-511bac31d3ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:57.235240 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-36a32066-9858-49b8-bc57-511bac31d3ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:57.532652 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-36a32066-9858-49b8-bc57-511bac31d3ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.311227 Aug 30 07:49:57.533444 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 171/384] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:57 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:49:57.566103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dc7298c9-d3f6-4f04-ad66-f5bcf0aa0ebe tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:57.566731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dc7298c9-d3f6-4f04-ad66-f5bcf0aa0ebe tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:57.574844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dc7298c9-d3f6-4f04-ad66-f5bcf0aa0ebe tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:57.575291 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dc7298c9-d3f6-4f04-ad66-f5bcf0aa0ebe tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:57.576475 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dc7298c9-d3f6-4f04-ad66-f5bcf0aa0ebe tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:57.576736 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dc7298c9-d3f6-4f04-ad66-f5bcf0aa0ebe tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:57.779602 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-60431253-e528-42c5-aa16-e5b7adabe9dc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:57.781207 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-60431253-e528-42c5-aa16-e5b7adabe9dc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:57.791072 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-dc7298c9-d3f6-4f04-ad66-f5bcf0aa0ebe tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:57.791289 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-60431253-e528-42c5-aa16-e5b7adabe9dc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:57.791824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-60431253-e528-42c5-aa16-e5b7adabe9dc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:57.792958 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-60431253-e528-42c5-aa16-e5b7adabe9dc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:57.793589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-60431253-e528-42c5-aa16-e5b7adabe9dc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:57.799970 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dc7298c9-d3f6-4f04-ad66-f5bcf0aa0ebe tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.237436 Aug 30 07:49:57.810658 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 214/385] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:57 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:57.815728 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-4b02deb4-10fd-4e3a-a413-585e52eb07e0 req-081c737e-f6c0-4d18-ba27-17efdbaaa8ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f", "tag": "32f744e1-43b5-4cbe-a3b6-9ee81f793879"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:57.817313 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:49:57.817313 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:49:57.825132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-4b02deb4-10fd-4e3a-a413-585e52eb07e0 req-081c737e-f6c0-4d18-ba27-17efdbaaa8ad service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:57.825856 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-4b02deb4-10fd-4e3a-a413-585e52eb07e0 req-081c737e-f6c0-4d18-ba27-17efdbaaa8ad service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:57.837863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-4b02deb4-10fd-4e3a-a413-585e52eb07e0 req-081c737e-f6c0-4d18-ba27-17efdbaaa8ad service nova] Creating event network-changed:32f744e1-43b5-4cbe-a3b6-9ee81f793879 for instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f on hv-cinder-80619 Aug 30 07:49:57.842794 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-4b02deb4-10fd-4e3a-a413-585e52eb07e0 req-081c737e-f6c0-4d18-ba27-17efdbaaa8ad service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030611 Aug 30 07:49:57.843454 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 215/386] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:49:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:49:57.900214 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e0aa7920-8ecf-48fd-bc28-f1d639ad529e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:57.900919 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e0aa7920-8ecf-48fd-bc28-f1d639ad529e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:57.907330 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0aa7920-8ecf-48fd-bc28-f1d639ad529e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:57.908062 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0aa7920-8ecf-48fd-bc28-f1d639ad529e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:57.908848 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0aa7920-8ecf-48fd-bc28-f1d639ad529e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:57.909284 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0aa7920-8ecf-48fd-bc28-f1d639ad529e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:57.997412 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-60431253-e528-42c5-aa16-e5b7adabe9dc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 14 microversion: 2.20 time: 0.223654 Aug 30 07:49:57.997705 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 172/387] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:49:57 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 14 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:58.157400 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e0aa7920-8ecf-48fd-bc28-f1d639ad529e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:58.166768 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e0aa7920-8ecf-48fd-bc28-f1d639ad529e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.270765 Aug 30 07:49:58.167532 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 216/388] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:57 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:58.238424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b98a851e-a6c7-44d8-a172-f3887f3ac6ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:58.239273 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b98a851e-a6c7-44d8-a172-f3887f3ac6ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:58.246251 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b98a851e-a6c7-44d8-a172-f3887f3ac6ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:58.246568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b98a851e-a6c7-44d8-a172-f3887f3ac6ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:58.247604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b98a851e-a6c7-44d8-a172-f3887f3ac6ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:58.247982 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b98a851e-a6c7-44d8-a172-f3887f3ac6ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:58.404533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b98a851e-a6c7-44d8-a172-f3887f3ac6ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:58.419718 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b98a851e-a6c7-44d8-a172-f3887f3ac6ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.185641 Aug 30 07:49:58.420628 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 173/389] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:58 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:58.544911 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6274372c-7697-46ba-899c-aa5bf61d4e20 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:58.545924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6274372c-7697-46ba-899c-aa5bf61d4e20 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:58.556039 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6274372c-7697-46ba-899c-aa5bf61d4e20 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:58.556502 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6274372c-7697-46ba-899c-aa5bf61d4e20 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:58.557292 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6274372c-7697-46ba-899c-aa5bf61d4e20 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:58.557742 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6274372c-7697-46ba-899c-aa5bf61d4e20 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:58.817159 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f86e10f0-df2e-4065-9dad-a8f6e9ed785a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:58.818670 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f86e10f0-df2e-4065-9dad-a8f6e9ed785a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:58.825384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f86e10f0-df2e-4065-9dad-a8f6e9ed785a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:58.825851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f86e10f0-df2e-4065-9dad-a8f6e9ed785a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:58.826681 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f86e10f0-df2e-4065-9dad-a8f6e9ed785a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:58.827116 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f86e10f0-df2e-4065-9dad-a8f6e9ed785a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:58.862888 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6274372c-7697-46ba-899c-aa5bf61d4e20 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.321569 Aug 30 07:49:58.878527 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 217/390] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:58 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:49:58.981960 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f86e10f0-df2e-4065-9dad-a8f6e9ed785a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:58.998252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f86e10f0-df2e-4065-9dad-a8f6e9ed785a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.184574 Aug 30 07:49:58.999011 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 174/391] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:58 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:59.011753 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5564fa45-7cfd-44d2-b7b2-a87d74a1a88f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:59.012707 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5564fa45-7cfd-44d2-b7b2-a87d74a1a88f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:59.019481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5564fa45-7cfd-44d2-b7b2-a87d74a1a88f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:59.019933 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5564fa45-7cfd-44d2-b7b2-a87d74a1a88f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:59.020688 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5564fa45-7cfd-44d2-b7b2-a87d74a1a88f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:59.021803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5564fa45-7cfd-44d2-b7b2-a87d74a1a88f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:59.184192 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-59d3e114-095f-44cf-9fd8-10bc20667fbf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:59.184855 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-59d3e114-095f-44cf-9fd8-10bc20667fbf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:59.191004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59d3e114-095f-44cf-9fd8-10bc20667fbf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:59.191420 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59d3e114-095f-44cf-9fd8-10bc20667fbf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:59.192225 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59d3e114-095f-44cf-9fd8-10bc20667fbf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:59.192681 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59d3e114-095f-44cf-9fd8-10bc20667fbf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:59.275472 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5564fa45-7cfd-44d2-b7b2-a87d74a1a88f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 14 microversion: 2.20 time: 0.267697 Aug 30 07:49:59.276742 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 218/392] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:49:59 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 14 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:59.339104 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-59d3e114-095f-44cf-9fd8-10bc20667fbf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:59.347088 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-59d3e114-095f-44cf-9fd8-10bc20667fbf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.166632 Aug 30 07:49:59.347663 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 175/393] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:59 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:49:59.438040 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-349ba97e-6337-43f0-91df-a4e00d11498d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:49:59.438864 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-349ba97e-6337-43f0-91df-a4e00d11498d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:59.446241 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-349ba97e-6337-43f0-91df-a4e00d11498d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:59.446807 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-349ba97e-6337-43f0-91df-a4e00d11498d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:59.447685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-349ba97e-6337-43f0-91df-a4e00d11498d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:59.448348 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-349ba97e-6337-43f0-91df-a4e00d11498d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:59.585541 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-349ba97e-6337-43f0-91df-a4e00d11498d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:49:59.594427 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-349ba97e-6337-43f0-91df-a4e00d11498d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.160795 Aug 30 07:49:59.595016 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 219/394] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:49:59 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:49:59.875965 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8b28f23d-8962-4487-bbb3-1c4e2ad88fce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:49:59.877123 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8b28f23d-8962-4487-bbb3-1c4e2ad88fce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:49:59.884696 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b28f23d-8962-4487-bbb3-1c4e2ad88fce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:59.885158 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b28f23d-8962-4487-bbb3-1c4e2ad88fce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:59.885947 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b28f23d-8962-4487-bbb3-1c4e2ad88fce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:49:59.886421 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b28f23d-8962-4487-bbb3-1c4e2ad88fce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:49:59.953068 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8b28f23d-8962-4487-bbb3-1c4e2ad88fce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.081816 Aug 30 07:49:59.957029 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 176/395] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:49:59 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:00.016943 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-231561cd-3742-4a07-b9be-701934e36dae tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:00.017595 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-231561cd-3742-4a07-b9be-701934e36dae tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:00.024401 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-231561cd-3742-4a07-b9be-701934e36dae tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:00.024847 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-231561cd-3742-4a07-b9be-701934e36dae tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:00.025615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-231561cd-3742-4a07-b9be-701934e36dae tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:00.026046 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-231561cd-3742-4a07-b9be-701934e36dae tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:00.154025 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-231561cd-3742-4a07-b9be-701934e36dae tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:00.161354 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-231561cd-3742-4a07-b9be-701934e36dae tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.148339 Aug 30 07:50:00.162893 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 220/396] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:00 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:00.288086 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0e8c5728-7b06-47f6-9e13-c7dbce7c7492 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:00.289366 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0e8c5728-7b06-47f6-9e13-c7dbce7c7492 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:00.296466 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0e8c5728-7b06-47f6-9e13-c7dbce7c7492 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:00.297120 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0e8c5728-7b06-47f6-9e13-c7dbce7c7492 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:00.298193 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0e8c5728-7b06-47f6-9e13-c7dbce7c7492 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:00.298869 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0e8c5728-7b06-47f6-9e13-c7dbce7c7492 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:00.364504 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-36174756-f65c-43f0-83c3-0f60191ca07d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:00.365326 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-36174756-f65c-43f0-83c3-0f60191ca07d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:00.373174 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0e8c5728-7b06-47f6-9e13-c7dbce7c7492 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 14 microversion: 2.20 time: 0.089082 Aug 30 07:50:00.373851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 177/397] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:00 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:00.379324 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-36174756-f65c-43f0-83c3-0f60191ca07d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:00.379763 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-36174756-f65c-43f0-83c3-0f60191ca07d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:00.381268 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-36174756-f65c-43f0-83c3-0f60191ca07d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:00.381268 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-36174756-f65c-43f0-83c3-0f60191ca07d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:00.547109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-36174756-f65c-43f0-83c3-0f60191ca07d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:00.558627 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-36174756-f65c-43f0-83c3-0f60191ca07d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.198320 Aug 30 07:50:00.560112 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 221/398] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:00 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:00.560801 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-cd55cb74-43fb-438e-a0b7-0ad3856d6735 req-71dbf058-b184-4950-af11-3c0e3eb939a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4452d5f-87e6-4c7e-9d92-71d489324d18", "name": "network-vif-plugged", "status": "completed", "tag": "0c1fdca9-6459-41de-9778-c72124cf39a8"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:00.562602 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:50:00.562602 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:50:00.571674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-cd55cb74-43fb-438e-a0b7-0ad3856d6735 req-71dbf058-b184-4950-af11-3c0e3eb939a0 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:00.572428 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-cd55cb74-43fb-438e-a0b7-0ad3856d6735 req-71dbf058-b184-4950-af11-3c0e3eb939a0 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:00.585625 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-cd55cb74-43fb-438e-a0b7-0ad3856d6735 req-71dbf058-b184-4950-af11-3c0e3eb939a0 service nova] Creating event network-vif-plugged:0c1fdca9-6459-41de-9778-c72124cf39a8 for instance a4452d5f-87e6-4c7e-9d92-71d489324d18 on hv-cinder-80619 Aug 30 07:50:00.590988 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-cd55cb74-43fb-438e-a0b7-0ad3856d6735 req-71dbf058-b184-4950-af11-3c0e3eb939a0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035722 Aug 30 07:50:00.591575 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 178/399] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:50:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:50:00.612609 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e11688af-dad7-4294-a98e-6268747dd6c3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:00.613228 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e11688af-dad7-4294-a98e-6268747dd6c3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:00.628897 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e11688af-dad7-4294-a98e-6268747dd6c3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:00.629340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e11688af-dad7-4294-a98e-6268747dd6c3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:00.632150 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e11688af-dad7-4294-a98e-6268747dd6c3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:00.632598 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e11688af-dad7-4294-a98e-6268747dd6c3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:00.780785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e11688af-dad7-4294-a98e-6268747dd6c3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:00.788611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e11688af-dad7-4294-a98e-6268747dd6c3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.180454 Aug 30 07:50:00.789186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 222/400] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:00 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:00.965789 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c6c74b62-9d31-4c3b-8816-6e3c52d2ee7e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:00.967011 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c6c74b62-9d31-4c3b-8816-6e3c52d2ee7e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:00.974867 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c6c74b62-9d31-4c3b-8816-6e3c52d2ee7e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:00.975317 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c6c74b62-9d31-4c3b-8816-6e3c52d2ee7e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:00.976099 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c6c74b62-9d31-4c3b-8816-6e3c52d2ee7e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:00.976534 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c6c74b62-9d31-4c3b-8816-6e3c52d2ee7e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:01.179647 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-12e3484f-0bf7-436c-b4ed-9daaf8ac3f9f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:01.180228 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-12e3484f-0bf7-436c-b4ed-9daaf8ac3f9f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:01.186342 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-12e3484f-0bf7-436c-b4ed-9daaf8ac3f9f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:01.187077 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-12e3484f-0bf7-436c-b4ed-9daaf8ac3f9f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:01.187591 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-12e3484f-0bf7-436c-b4ed-9daaf8ac3f9f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:01.188062 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-12e3484f-0bf7-436c-b4ed-9daaf8ac3f9f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:01.316945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-12e3484f-0bf7-436c-b4ed-9daaf8ac3f9f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:01.324239 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-12e3484f-0bf7-436c-b4ed-9daaf8ac3f9f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.149107 Aug 30 07:50:01.324812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 223/401] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:01 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:01.384728 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3f571397-8e5b-41dd-a764-d6f0ab265dbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:01.385719 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3f571397-8e5b-41dd-a764-d6f0ab265dbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:01.391878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3f571397-8e5b-41dd-a764-d6f0ab265dbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:01.392320 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3f571397-8e5b-41dd-a764-d6f0ab265dbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:01.393086 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3f571397-8e5b-41dd-a764-d6f0ab265dbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:01.393520 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3f571397-8e5b-41dd-a764-d6f0ab265dbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:05.103172 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c6c74b62-9d31-4c3b-8816-6e3c52d2ee7e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 4.141165 Aug 30 07:50:05.103739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 179/402] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:00 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 4143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:05.110263 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3f571397-8e5b-41dd-a764-d6f0ab265dbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 14 microversion: 2.20 time: 3.729146 Aug 30 07:50:05.111212 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 224/403] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:01 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 14 bytes in 3731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:05.120801 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5cb89096-a760-4db3-9920-87c3f2f609dd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:05.122917 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-52ef1729-a957-4d74-aaf0-b27ceb49019d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:05.123952 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-52ef1729-a957-4d74-aaf0-b27ceb49019d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:05.130898 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-52ef1729-a957-4d74-aaf0-b27ceb49019d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:05.131424 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-52ef1729-a957-4d74-aaf0-b27ceb49019d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:05.132210 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-52ef1729-a957-4d74-aaf0-b27ceb49019d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:05.133282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-52ef1729-a957-4d74-aaf0-b27ceb49019d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:05.136493 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5cb89096-a760-4db3-9920-87c3f2f609dd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:05.143315 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cb89096-a760-4db3-9920-87c3f2f609dd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:05.143771 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cb89096-a760-4db3-9920-87c3f2f609dd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:05.144555 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cb89096-a760-4db3-9920-87c3f2f609dd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:05.144983 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5cb89096-a760-4db3-9920-87c3f2f609dd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:05.275714 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5cb89096-a760-4db3-9920-87c3f2f609dd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:05.276179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-52ef1729-a957-4d74-aaf0-b27ceb49019d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:05.283305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5cb89096-a760-4db3-9920-87c3f2f609dd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.167435 Aug 30 07:50:05.283500 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-52ef1729-a957-4d74-aaf0-b27ceb49019d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.171098 Aug 30 07:50:05.283923 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 180/404] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:05 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:05.286650 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 225/405] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:05 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:05.289050 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-22ea5b8f-629b-4d6f-9915-e9ff4eaebdf2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:05.289821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-22ea5b8f-629b-4d6f-9915-e9ff4eaebdf2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:05.295856 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-22ea5b8f-629b-4d6f-9915-e9ff4eaebdf2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:05.296300 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-22ea5b8f-629b-4d6f-9915-e9ff4eaebdf2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:05.297070 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-22ea5b8f-629b-4d6f-9915-e9ff4eaebdf2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:05.297501 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-22ea5b8f-629b-4d6f-9915-e9ff4eaebdf2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:05.425009 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-22ea5b8f-629b-4d6f-9915-e9ff4eaebdf2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:05.433604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-22ea5b8f-629b-4d6f-9915-e9ff4eaebdf2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.148542 Aug 30 07:50:05.434196 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 181/406] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:05 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:06.114919 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4d5dc364-29b9-4da3-8fce-b6b000a76015 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:06.117878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4d5dc364-29b9-4da3-8fce-b6b000a76015 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:06.123966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d5dc364-29b9-4da3-8fce-b6b000a76015 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:06.124666 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d5dc364-29b9-4da3-8fce-b6b000a76015 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:06.125456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d5dc364-29b9-4da3-8fce-b6b000a76015 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:06.125720 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-05f9b59d-d389-432e-888d-72d932669c5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:06.126463 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d5dc364-29b9-4da3-8fce-b6b000a76015 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:06.128682 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-05f9b59d-d389-432e-888d-72d932669c5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:06.139946 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05f9b59d-d389-432e-888d-72d932669c5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:06.140805 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05f9b59d-d389-432e-888d-72d932669c5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:06.142207 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05f9b59d-d389-432e-888d-72d932669c5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:06.142978 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05f9b59d-d389-432e-888d-72d932669c5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:08.164783 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-05f9b59d-d389-432e-888d-72d932669c5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 14 microversion: 2.20 time: 2.045354 Aug 30 07:50:08.165425 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 182/407] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:06 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 14 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:08.170359 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d1e534c1-e28f-42cc-96c5-a5163f5fdb3d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:08.171063 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d1e534c1-e28f-42cc-96c5-a5163f5fdb3d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:08.177911 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4d5dc364-29b9-4da3-8fce-b6b000a76015 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 2.066574 Aug 30 07:50:08.178676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1e534c1-e28f-42cc-96c5-a5163f5fdb3d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:08.178905 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1e534c1-e28f-42cc-96c5-a5163f5fdb3d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:08.180625 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1e534c1-e28f-42cc-96c5-a5163f5fdb3d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:08.180757 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1e534c1-e28f-42cc-96c5-a5163f5fdb3d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:08.183479 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 226/408] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:06 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:08.189588 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c7d70115-7222-47b6-98ad-7f629ec49daf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:08.190332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c7d70115-7222-47b6-98ad-7f629ec49daf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:08.198701 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c7d70115-7222-47b6-98ad-7f629ec49daf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:08.199147 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c7d70115-7222-47b6-98ad-7f629ec49daf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:08.200083 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c7d70115-7222-47b6-98ad-7f629ec49daf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:08.200828 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c7d70115-7222-47b6-98ad-7f629ec49daf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:08.338649 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d1e534c1-e28f-42cc-96c5-a5163f5fdb3d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:08.345850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d1e534c1-e28f-42cc-96c5-a5163f5fdb3d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.179307 Aug 30 07:50:08.346397 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c7d70115-7222-47b6-98ad-7f629ec49daf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:08.346538 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 183/409] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:08 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:08.350730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cbeb955e-dab9-4737-b423-ab4f39600a1e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:08.352032 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-cbeb955e-dab9-4737-b423-ab4f39600a1e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:08.355431 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c7d70115-7222-47b6-98ad-7f629ec49daf tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.170409 Aug 30 07:50:08.356411 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 227/410] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:08 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:08.357521 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cbeb955e-dab9-4737-b423-ab4f39600a1e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:08.357966 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cbeb955e-dab9-4737-b423-ab4f39600a1e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:08.358768 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cbeb955e-dab9-4737-b423-ab4f39600a1e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:08.359195 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cbeb955e-dab9-4737-b423-ab4f39600a1e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:08.478582 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-cbeb955e-dab9-4737-b423-ab4f39600a1e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:08.485718 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-cbeb955e-dab9-4737-b423-ab4f39600a1e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.138333 Aug 30 07:50:08.486297 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 184/411] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:08 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:09.175508 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-17cb3383-e2f2-40dd-85fe-190e8be07aa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:09.176432 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-17cb3383-e2f2-40dd-85fe-190e8be07aa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:09.182731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17cb3383-e2f2-40dd-85fe-190e8be07aa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:09.183199 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17cb3383-e2f2-40dd-85fe-190e8be07aa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:09.183936 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17cb3383-e2f2-40dd-85fe-190e8be07aa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:09.184367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17cb3383-e2f2-40dd-85fe-190e8be07aa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:09.190754 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ba3585a5-b351-4bf2-84f8-a92f0b4e8797 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:09.191730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ba3585a5-b351-4bf2-84f8-a92f0b4e8797 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:09.198545 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ba3585a5-b351-4bf2-84f8-a92f0b4e8797 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:09.199006 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ba3585a5-b351-4bf2-84f8-a92f0b4e8797 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:09.199784 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ba3585a5-b351-4bf2-84f8-a92f0b4e8797 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:09.200237 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ba3585a5-b351-4bf2-84f8-a92f0b4e8797 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:09.314829 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ba3585a5-b351-4bf2-84f8-a92f0b4e8797 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.127456 Aug 30 07:50:09.315479 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 185/412] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:09 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:50:09.330276 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-17cb3383-e2f2-40dd-85fe-190e8be07aa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 14 microversion: 2.20 time: 0.158177 Aug 30 07:50:09.330910 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 228/413] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:09 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:09.363318 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-01beecc9-2d1c-45fb-a7d9-117d2838f10b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:09.364046 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-01beecc9-2d1c-45fb-a7d9-117d2838f10b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:09.371409 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-01beecc9-2d1c-45fb-a7d9-117d2838f10b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:09.371865 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-01beecc9-2d1c-45fb-a7d9-117d2838f10b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:09.372636 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-01beecc9-2d1c-45fb-a7d9-117d2838f10b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:09.373073 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-01beecc9-2d1c-45fb-a7d9-117d2838f10b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:09.373289 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9363b9ae-9311-44fd-95f1-047a5dfe2316 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:09.374038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9363b9ae-9311-44fd-95f1-047a5dfe2316 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:09.380668 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9363b9ae-9311-44fd-95f1-047a5dfe2316 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:09.381109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9363b9ae-9311-44fd-95f1-047a5dfe2316 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:09.381871 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9363b9ae-9311-44fd-95f1-047a5dfe2316 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:09.382940 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9363b9ae-9311-44fd-95f1-047a5dfe2316 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:09.500758 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-01beecc9-2d1c-45fb-a7d9-117d2838f10b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:09.509050 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-01beecc9-2d1c-45fb-a7d9-117d2838f10b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.149507 Aug 30 07:50:09.509694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 186/414] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:09 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:09.512775 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9363b9ae-9311-44fd-95f1-047a5dfe2316 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:09.514659 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5e1eea9f-9faf-41ae-9a43-1ea3f3caa0b3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:09.515444 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5e1eea9f-9faf-41ae-9a43-1ea3f3caa0b3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:09.520619 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9363b9ae-9311-44fd-95f1-047a5dfe2316 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.152541 Aug 30 07:50:09.520998 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5e1eea9f-9faf-41ae-9a43-1ea3f3caa0b3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:09.521177 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 229/415] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:09 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:09.521445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5e1eea9f-9faf-41ae-9a43-1ea3f3caa0b3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:09.522235 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5e1eea9f-9faf-41ae-9a43-1ea3f3caa0b3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:09.522788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5e1eea9f-9faf-41ae-9a43-1ea3f3caa0b3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:09.645771 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5e1eea9f-9faf-41ae-9a43-1ea3f3caa0b3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:09.653661 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5e1eea9f-9faf-41ae-9a43-1ea3f3caa0b3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.142720 Aug 30 07:50:09.654252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 187/416] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:09 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:10.326534 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9d204d09-fd7d-4ec1-a8cb-a67a7fcfdb46 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:10.327494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9d204d09-fd7d-4ec1-a8cb-a67a7fcfdb46 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:10.333451 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d204d09-fd7d-4ec1-a8cb-a67a7fcfdb46 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:10.333963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d204d09-fd7d-4ec1-a8cb-a67a7fcfdb46 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:10.336851 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d204d09-fd7d-4ec1-a8cb-a67a7fcfdb46 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:10.337297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d204d09-fd7d-4ec1-a8cb-a67a7fcfdb46 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:10.340958 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-42b7f356-a864-44e6-9560-6cb07ac0fa3f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:10.342496 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-42b7f356-a864-44e6-9560-6cb07ac0fa3f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:10.348593 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-42b7f356-a864-44e6-9560-6cb07ac0fa3f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:10.349051 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-42b7f356-a864-44e6-9560-6cb07ac0fa3f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:10.349831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-42b7f356-a864-44e6-9560-6cb07ac0fa3f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:10.350297 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-42b7f356-a864-44e6-9560-6cb07ac0fa3f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:10.552155 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-42b7f356-a864-44e6-9560-6cb07ac0fa3f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 14 microversion: 2.20 time: 0.214692 Aug 30 07:50:10.552794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 188/417] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:10 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:10.558509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4d6cf860-24a5-4a93-af6c-cf588fdc6b1f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:10.559147 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4d6cf860-24a5-4a93-af6c-cf588fdc6b1f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:10.560755 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9d204d09-fd7d-4ec1-a8cb-a67a7fcfdb46 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.238056 Aug 30 07:50:10.561669 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 230/418] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:10 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:10.565775 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4d6cf860-24a5-4a93-af6c-cf588fdc6b1f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:10.566252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4d6cf860-24a5-4a93-af6c-cf588fdc6b1f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:10.566477 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-044b8ddf-f588-434d-a050-db72db9adef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:10.567031 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4d6cf860-24a5-4a93-af6c-cf588fdc6b1f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:10.567171 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-044b8ddf-f588-434d-a050-db72db9adef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:10.567483 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4d6cf860-24a5-4a93-af6c-cf588fdc6b1f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:10.574582 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-044b8ddf-f588-434d-a050-db72db9adef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:10.575027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-044b8ddf-f588-434d-a050-db72db9adef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:10.576081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-044b8ddf-f588-434d-a050-db72db9adef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:10.576632 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-044b8ddf-f588-434d-a050-db72db9adef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:10.699381 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-044b8ddf-f588-434d-a050-db72db9adef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:10.699546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4d6cf860-24a5-4a93-af6c-cf588fdc6b1f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:10.706769 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-044b8ddf-f588-434d-a050-db72db9adef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.144168 Aug 30 07:50:10.706932 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4d6cf860-24a5-4a93-af6c-cf588fdc6b1f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.152807 Aug 30 07:50:10.707332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 231/419] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:10 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:10.707790 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 189/420] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:10 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:10.711649 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-628803cd-c34d-4b5c-8945-a1fcb3b023e9 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:10.712256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-628803cd-c34d-4b5c-8945-a1fcb3b023e9 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:10.717891 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-628803cd-c34d-4b5c-8945-a1fcb3b023e9 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:10.718372 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-628803cd-c34d-4b5c-8945-a1fcb3b023e9 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:10.719133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-628803cd-c34d-4b5c-8945-a1fcb3b023e9 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:10.719568 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-628803cd-c34d-4b5c-8945-a1fcb3b023e9 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:10.839109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-628803cd-c34d-4b5c-8945-a1fcb3b023e9 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:10.846335 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-628803cd-c34d-4b5c-8945-a1fcb3b023e9 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1313 microversion: 2.1 time: 0.138022 Aug 30 07:50:10.846898 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 232/421] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:10 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:11.563777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ca088fff-0d7a-48fa-ab75-2819d38d33ef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:11.564614 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ca088fff-0d7a-48fa-ab75-2819d38d33ef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:11.571118 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ca088fff-0d7a-48fa-ab75-2819d38d33ef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:11.571583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ca088fff-0d7a-48fa-ab75-2819d38d33ef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:11.572332 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ca088fff-0d7a-48fa-ab75-2819d38d33ef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:11.572770 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ca088fff-0d7a-48fa-ab75-2819d38d33ef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:11.573456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d8d83cbd-1018-4159-b049-3beeb8d52371 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:11.574778 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d8d83cbd-1018-4159-b049-3beeb8d52371 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:11.581147 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d8d83cbd-1018-4159-b049-3beeb8d52371 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:11.581584 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d8d83cbd-1018-4159-b049-3beeb8d52371 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:11.582383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d8d83cbd-1018-4159-b049-3beeb8d52371 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:11.582812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d8d83cbd-1018-4159-b049-3beeb8d52371 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:11.769518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d8d83cbd-1018-4159-b049-3beeb8d52371 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.200749 Aug 30 07:50:11.773250 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 233/422] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:11 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:11.775597 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f2541c74-d821-41b8-99e9-43ccb867a161 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:11.776293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f2541c74-d821-41b8-99e9-43ccb867a161 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:11.782679 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f2541c74-d821-41b8-99e9-43ccb867a161 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:11.783127 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f2541c74-d821-41b8-99e9-43ccb867a161 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:11.783892 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f2541c74-d821-41b8-99e9-43ccb867a161 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:11.784342 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f2541c74-d821-41b8-99e9-43ccb867a161 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:11.794818 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ca088fff-0d7a-48fa-ab75-2819d38d33ef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 2680 microversion: 2.20 time: 0.234638 Aug 30 07:50:11.795437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 190/423] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:11 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 2680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:50:11.800698 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-dd806eb5-8df7-4a53-8249-375361e32144 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:11.801501 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-dd806eb5-8df7-4a53-8249-375361e32144 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:11.808153 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd806eb5-8df7-4a53-8249-375361e32144 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:11.808698 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd806eb5-8df7-4a53-8249-375361e32144 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:11.809551 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd806eb5-8df7-4a53-8249-375361e32144 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:11.810002 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd806eb5-8df7-4a53-8249-375361e32144 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:11.919920 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f2541c74-d821-41b8-99e9-43ccb867a161 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:11.927885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f2541c74-d821-41b8-99e9-43ccb867a161 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.156173 Aug 30 07:50:11.928345 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 234/424] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:11 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:11.932932 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-72a77646-574d-4335-98fa-f917059bae0a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:11.933554 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-72a77646-574d-4335-98fa-f917059bae0a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:11.939929 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72a77646-574d-4335-98fa-f917059bae0a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:11.940375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72a77646-574d-4335-98fa-f917059bae0a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:11.941213 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72a77646-574d-4335-98fa-f917059bae0a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:11.941653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72a77646-574d-4335-98fa-f917059bae0a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:11.959526 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-dd806eb5-8df7-4a53-8249-375361e32144 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:11.974728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-dd806eb5-8df7-4a53-8249-375361e32144 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.177725 Aug 30 07:50:11.975323 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 191/425] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:11 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:12.077487 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-7e5f09d8-2c25-4101-92e3-a7c421480575 req-e2b51996-43a7-4fec-8e05-76e57d7be2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b32f1264-9680-449b-a1eb-c42ea5401715", "name": "network-vif-plugged", "status": "completed", "tag": "ed47d797-7cde-4038-9cf6-19c7781b0f13"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:12.078945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:50:12.078945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:50:12.080627 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-72a77646-574d-4335-98fa-f917059bae0a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:12.086470 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-7e5f09d8-2c25-4101-92e3-a7c421480575 req-e2b51996-43a7-4fec-8e05-76e57d7be2c6 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:12.087400 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-7e5f09d8-2c25-4101-92e3-a7c421480575 req-e2b51996-43a7-4fec-8e05-76e57d7be2c6 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:12.095412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-72a77646-574d-4335-98fa-f917059bae0a tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1496 microversion: 2.1 time: 0.165989 Aug 30 07:50:12.096490 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 235/426] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:11 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:12.109873 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-7e5f09d8-2c25-4101-92e3-a7c421480575 req-e2b51996-43a7-4fec-8e05-76e57d7be2c6 service nova] Creating event network-vif-plugged:ed47d797-7cde-4038-9cf6-19c7781b0f13 for instance b32f1264-9680-449b-a1eb-c42ea5401715 on hv-cinder-80619 Aug 30 07:50:12.115339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-7e5f09d8-2c25-4101-92e3-a7c421480575 req-e2b51996-43a7-4fec-8e05-76e57d7be2c6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041529 Aug 30 07:50:12.116226 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 192/427] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:50:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:50:12.780887 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6b002684-7f72-48f3-a71b-3f25abd03d1c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:12.781795 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6b002684-7f72-48f3-a71b-3f25abd03d1c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:12.787924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6b002684-7f72-48f3-a71b-3f25abd03d1c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:12.788357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6b002684-7f72-48f3-a71b-3f25abd03d1c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:12.789708 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6b002684-7f72-48f3-a71b-3f25abd03d1c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:12.790172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6b002684-7f72-48f3-a71b-3f25abd03d1c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:12.805337 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d1b2b56a-b5b6-4447-802c-4cb27da17fe1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:12.806411 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d1b2b56a-b5b6-4447-802c-4cb27da17fe1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:12.812736 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1b2b56a-b5b6-4447-802c-4cb27da17fe1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:12.813181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1b2b56a-b5b6-4447-802c-4cb27da17fe1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:12.813951 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1b2b56a-b5b6-4447-802c-4cb27da17fe1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:12.814406 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1b2b56a-b5b6-4447-802c-4cb27da17fe1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:12.900484 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6b002684-7f72-48f3-a71b-3f25abd03d1c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.123055 Aug 30 07:50:12.901130 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 236/428] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:12 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:12.924940 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d1b2b56a-b5b6-4447-802c-4cb27da17fe1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 10009 microversion: 2.20 time: 0.123573 Aug 30 07:50:12.925670 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 193/429] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:12 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 10009 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:50:12.944583 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bf0b7884-4cbf-4cb2-aff7-4b433fb0ab7c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:12.945999 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bf0b7884-4cbf-4cb2-aff7-4b433fb0ab7c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:12.952800 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf0b7884-4cbf-4cb2-aff7-4b433fb0ab7c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:12.953239 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf0b7884-4cbf-4cb2-aff7-4b433fb0ab7c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:12.954049 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf0b7884-4cbf-4cb2-aff7-4b433fb0ab7c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:12.954505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf0b7884-4cbf-4cb2-aff7-4b433fb0ab7c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:12.994331 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8fe71e42-79d4-445d-b260-77c5dce1c4d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:12.995079 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8fe71e42-79d4-445d-b260-77c5dce1c4d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:13.001309 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8fe71e42-79d4-445d-b260-77c5dce1c4d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:13.001763 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8fe71e42-79d4-445d-b260-77c5dce1c4d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:13.002832 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8fe71e42-79d4-445d-b260-77c5dce1c4d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:13.003271 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8fe71e42-79d4-445d-b260-77c5dce1c4d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:13.082779 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-bf0b7884-4cbf-4cb2-aff7-4b433fb0ab7c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:13.090732 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bf0b7884-4cbf-4cb2-aff7-4b433fb0ab7c tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.150558 Aug 30 07:50:13.091304 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 237/430] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:12 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:13.131008 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8fe71e42-79d4-445d-b260-77c5dce1c4d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:13.139118 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8fe71e42-79d4-445d-b260-77c5dce1c4d5 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.150306 Aug 30 07:50:13.139698 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 194/431] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:12 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:13.912181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3508ce6f-c56b-4ee0-aa8b-a871fc6a3169 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:13.913093 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3508ce6f-c56b-4ee0-aa8b-a871fc6a3169 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:13.919455 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3508ce6f-c56b-4ee0-aa8b-a871fc6a3169 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:13.919996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3508ce6f-c56b-4ee0-aa8b-a871fc6a3169 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:13.920747 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3508ce6f-c56b-4ee0-aa8b-a871fc6a3169 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:13.921177 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3508ce6f-c56b-4ee0-aa8b-a871fc6a3169 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:13.936662 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c340a471-7e88-4045-9375-2d69cef1314f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:13.937575 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c340a471-7e88-4045-9375-2d69cef1314f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:13.943482 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c340a471-7e88-4045-9375-2d69cef1314f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:13.943929 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c340a471-7e88-4045-9375-2d69cef1314f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:13.944699 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c340a471-7e88-4045-9375-2d69cef1314f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:13.945116 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c340a471-7e88-4045-9375-2d69cef1314f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:14.239270 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c340a471-7e88-4045-9375-2d69cef1314f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 16110 microversion: 2.20 time: 0.306026 Aug 30 07:50:14.242837 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 195/432] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:13 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 16110 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:50:14.244801 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-41eeb8e8-8b0e-458f-a0f2-6f5dcbd048e0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:14.245500 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-41eeb8e8-8b0e-458f-a0f2-6f5dcbd048e0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:14.249111 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3508ce6f-c56b-4ee0-aa8b-a871fc6a3169 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.340373 Aug 30 07:50:14.249776 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 238/433] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:13 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:14.252202 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41eeb8e8-8b0e-458f-a0f2-6f5dcbd048e0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:14.252910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41eeb8e8-8b0e-458f-a0f2-6f5dcbd048e0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:14.253770 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41eeb8e8-8b0e-458f-a0f2-6f5dcbd048e0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:14.254242 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41eeb8e8-8b0e-458f-a0f2-6f5dcbd048e0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:14.255821 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6fad17f7-fd35-4e39-8636-fdb8ec43b75d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:14.256397 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6fad17f7-fd35-4e39-8636-fdb8ec43b75d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:14.264269 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6fad17f7-fd35-4e39-8636-fdb8ec43b75d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:14.264741 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6fad17f7-fd35-4e39-8636-fdb8ec43b75d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:14.265639 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6fad17f7-fd35-4e39-8636-fdb8ec43b75d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:14.266081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6fad17f7-fd35-4e39-8636-fdb8ec43b75d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:14.380065 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-41eeb8e8-8b0e-458f-a0f2-6f5dcbd048e0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:14.388433 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-41eeb8e8-8b0e-458f-a0f2-6f5dcbd048e0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1318 microversion: 2.1 time: 0.147292 Aug 30 07:50:14.388634 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6fad17f7-fd35-4e39-8636-fdb8ec43b75d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:14.389061 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 196/434] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:14 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:14.396988 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6fad17f7-fd35-4e39-8636-fdb8ec43b75d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.145854 Aug 30 07:50:14.397700 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 239/435] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:14 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:15.250693 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-00a4a71e-5e0a-4b83-b49e-9c45ffe12f84 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:15.251609 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-00a4a71e-5e0a-4b83-b49e-9c45ffe12f84 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:15.258286 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00a4a71e-5e0a-4b83-b49e-9c45ffe12f84 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.258729 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00a4a71e-5e0a-4b83-b49e-9c45ffe12f84 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.259484 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00a4a71e-5e0a-4b83-b49e-9c45ffe12f84 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.259919 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00a4a71e-5e0a-4b83-b49e-9c45ffe12f84 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.260948 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-96803e2a-3bf2-4a97-addd-1638560ec3c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:15.261924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-96803e2a-3bf2-4a97-addd-1638560ec3c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:15.268131 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96803e2a-3bf2-4a97-addd-1638560ec3c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.268578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96803e2a-3bf2-4a97-addd-1638560ec3c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.269342 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96803e2a-3bf2-4a97-addd-1638560ec3c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.269806 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96803e2a-3bf2-4a97-addd-1638560ec3c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.337694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-00a4a71e-5e0a-4b83-b49e-9c45ffe12f84 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 18109 microversion: 2.20 time: 0.090643 Aug 30 07:50:15.339350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 197/436] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:15 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 18109 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:15.341958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-96803e2a-3bf2-4a97-addd-1638560ec3c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.084721 Aug 30 07:50:15.342617 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 240/437] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:15 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:50:15.405079 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ce60842a-177c-4ed2-a2b0-21b21b6e388d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:15.405767 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ce60842a-177c-4ed2-a2b0-21b21b6e388d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:15.412353 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ce60842a-177c-4ed2-a2b0-21b21b6e388d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.412799 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ce60842a-177c-4ed2-a2b0-21b21b6e388d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.413555 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ce60842a-177c-4ed2-a2b0-21b21b6e388d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.414663 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ce60842a-177c-4ed2-a2b0-21b21b6e388d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.415463 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f5bf8e08-c788-4aa4-9d26-be2f62b458e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:15.416162 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f5bf8e08-c788-4aa4-9d26-be2f62b458e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:15.422623 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f5bf8e08-c788-4aa4-9d26-be2f62b458e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.423075 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f5bf8e08-c788-4aa4-9d26-be2f62b458e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.423851 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f5bf8e08-c788-4aa4-9d26-be2f62b458e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.424285 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f5bf8e08-c788-4aa4-9d26-be2f62b458e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.539304 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ce60842a-177c-4ed2-a2b0-21b21b6e388d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:15.546687 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ce60842a-177c-4ed2-a2b0-21b21b6e388d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1508 microversion: 2.1 time: 0.145503 Aug 30 07:50:15.547254 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 198/438] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:15 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:15.547793 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f5bf8e08-c788-4aa4-9d26-be2f62b458e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:15.555908 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f5bf8e08-c788-4aa4-9d26-be2f62b458e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.145163 Aug 30 07:50:15.556487 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 241/439] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:15 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:15.693720 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b62c5bd6-9e25-4998-b2a3-a117795e3027 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:15.694406 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b62c5bd6-9e25-4998-b2a3-a117795e3027 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:15.700896 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b62c5bd6-9e25-4998-b2a3-a117795e3027 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.701344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b62c5bd6-9e25-4998-b2a3-a117795e3027 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.702096 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b62c5bd6-9e25-4998-b2a3-a117795e3027 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.702551 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b62c5bd6-9e25-4998-b2a3-a117795e3027 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.728056 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b62c5bd6-9e25-4998-b2a3-a117795e3027 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Going to try to terminate instance {{(pid=114670) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:50:15.843736 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b62c5bd6-9e25-4998-b2a3-a117795e3027 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 204 len: 0 microversion: 2.1 time: 0.147094 Aug 30 07:50:15.843736 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 199/440] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:50:15 2021] DELETE /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:50:15.845429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-88d452f5-37fe-4ddf-89e1-6094e21669fa tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:15.846044 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-88d452f5-37fe-4ddf-89e1-6094e21669fa tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:15.852405 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-88d452f5-37fe-4ddf-89e1-6094e21669fa tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.852846 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-88d452f5-37fe-4ddf-89e1-6094e21669fa tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.853638 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-88d452f5-37fe-4ddf-89e1-6094e21669fa tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:15.854067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-88d452f5-37fe-4ddf-89e1-6094e21669fa tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:15.980599 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-88d452f5-37fe-4ddf-89e1-6094e21669fa tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:15.987898 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-88d452f5-37fe-4ddf-89e1-6094e21669fa tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1502 microversion: 2.1 time: 0.146586 Aug 30 07:50:15.988459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 242/441] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:15 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:16.349700 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-dabd9622-07f2-4d56-912a-1bd9a7e35504 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:16.350725 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-dabd9622-07f2-4d56-912a-1bd9a7e35504 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:16.352579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e5b8e623-75d2-44e9-93b8-a73117f97a50 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:16.353495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e5b8e623-75d2-44e9-93b8-a73117f97a50 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:16.356650 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dabd9622-07f2-4d56-912a-1bd9a7e35504 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:16.357200 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dabd9622-07f2-4d56-912a-1bd9a7e35504 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:16.357971 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dabd9622-07f2-4d56-912a-1bd9a7e35504 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:16.358432 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dabd9622-07f2-4d56-912a-1bd9a7e35504 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:16.359460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e5b8e623-75d2-44e9-93b8-a73117f97a50 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:16.359916 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e5b8e623-75d2-44e9-93b8-a73117f97a50 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:16.360682 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e5b8e623-75d2-44e9-93b8-a73117f97a50 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:16.361132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e5b8e623-75d2-44e9-93b8-a73117f97a50 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:20.603850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-dabd9622-07f2-4d56-912a-1bd9a7e35504 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 24704 microversion: 2.20 time: 4.258050 Aug 30 07:50:20.605413 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 200/442] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:16 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 24704 bytes in 4261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:20.608476 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e5b8e623-75d2-44e9-93b8-a73117f97a50 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 4.259396 Aug 30 07:50:20.612228 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 243/443] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:16 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 4261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:50:20.612380 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ba4a7804-086a-40a1-9ba3-4782dc1c2e30 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:20.612380 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ba4a7804-086a-40a1-9ba3-4782dc1c2e30 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:20.613860 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fe8b7012-2b70-4c31-8aaf-080f3e080066 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:20.614713 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fe8b7012-2b70-4c31-8aaf-080f3e080066 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:20.618569 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ba4a7804-086a-40a1-9ba3-4782dc1c2e30 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:20.619025 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ba4a7804-086a-40a1-9ba3-4782dc1c2e30 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:20.619858 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ba4a7804-086a-40a1-9ba3-4782dc1c2e30 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:20.620290 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ba4a7804-086a-40a1-9ba3-4782dc1c2e30 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:20.621132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe8b7012-2b70-4c31-8aaf-080f3e080066 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:20.621585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe8b7012-2b70-4c31-8aaf-080f3e080066 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:20.622382 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe8b7012-2b70-4c31-8aaf-080f3e080066 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:20.622820 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe8b7012-2b70-4c31-8aaf-080f3e080066 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:20.753225 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ba4a7804-086a-40a1-9ba3-4782dc1c2e30 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:20.753572 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-fe8b7012-2b70-4c31-8aaf-080f3e080066 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:20.761938 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ba4a7804-086a-40a1-9ba3-4782dc1c2e30 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.155029 Aug 30 07:50:20.762233 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fe8b7012-2b70-4c31-8aaf-080f3e080066 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1502 microversion: 2.1 time: 0.151889 Aug 30 07:50:20.765177 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 244/445] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:20 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:20.765444 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 201/445] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:20 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:21.615082 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1fde225c-285a-4f73-ab48-72e76c5c10f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:21.615999 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1fde225c-285a-4f73-ab48-72e76c5c10f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:21.620302 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9c665c39-99a4-4279-803e-e35f6d377ab0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:21.621250 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9c665c39-99a4-4279-803e-e35f6d377ab0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:21.622959 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1fde225c-285a-4f73-ab48-72e76c5c10f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:21.623402 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1fde225c-285a-4f73-ab48-72e76c5c10f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:21.624173 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1fde225c-285a-4f73-ab48-72e76c5c10f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:21.624601 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1fde225c-285a-4f73-ab48-72e76c5c10f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:21.627681 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9c665c39-99a4-4279-803e-e35f6d377ab0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:21.628131 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9c665c39-99a4-4279-803e-e35f6d377ab0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:21.628891 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9c665c39-99a4-4279-803e-e35f6d377ab0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:21.629325 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9c665c39-99a4-4279-803e-e35f6d377ab0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:21.751820 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9c665c39-99a4-4279-803e-e35f6d377ab0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.135712 Aug 30 07:50:21.756153 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 202/446] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:21 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:50:21.780785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1fde225c-285a-4f73-ab48-72e76c5c10f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 25836 microversion: 2.20 time: 0.169285 Aug 30 07:50:21.781530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-db4e3538-236c-45af-8760-a44a2cf2edab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:21.782413 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 245/447] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:21 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 25836 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:21.785858 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-db4e3538-236c-45af-8760-a44a2cf2edab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:21.796982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9fa81abe-598a-4db8-bc92-237b4360e63e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:21.796982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9fa81abe-598a-4db8-bc92-237b4360e63e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:21.798454 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db4e3538-236c-45af-8760-a44a2cf2edab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:21.798908 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db4e3538-236c-45af-8760-a44a2cf2edab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:21.799760 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db4e3538-236c-45af-8760-a44a2cf2edab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:21.800220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db4e3538-236c-45af-8760-a44a2cf2edab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:21.803054 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9fa81abe-598a-4db8-bc92-237b4360e63e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:21.803548 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9fa81abe-598a-4db8-bc92-237b4360e63e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:21.804830 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9fa81abe-598a-4db8-bc92-237b4360e63e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:21.805358 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9fa81abe-598a-4db8-bc92-237b4360e63e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:21.938636 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9fa81abe-598a-4db8-bc92-237b4360e63e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:21.949298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-db4e3538-236c-45af-8760-a44a2cf2edab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:21.953915 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9fa81abe-598a-4db8-bc92-237b4360e63e tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1502 microversion: 2.1 time: 0.169868 Aug 30 07:50:21.954445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 246/448] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:21 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:21.967396 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-db4e3538-236c-45af-8760-a44a2cf2edab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.185067 Aug 30 07:50:21.968307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 203/449] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:21 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:22.764523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-efe08d5a-0cbe-48e7-a984-1082564884fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:22.765459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-efe08d5a-0cbe-48e7-a984-1082564884fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:22.771327 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-efe08d5a-0cbe-48e7-a984-1082564884fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:22.771773 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-efe08d5a-0cbe-48e7-a984-1082564884fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:22.772540 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-efe08d5a-0cbe-48e7-a984-1082564884fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:22.773611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-efe08d5a-0cbe-48e7-a984-1082564884fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:22.793028 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a8483fce-cd23-4ddd-9a03-bd87903b364b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:22.793979 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a8483fce-cd23-4ddd-9a03-bd87903b364b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:22.801119 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a8483fce-cd23-4ddd-9a03-bd87903b364b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:22.801943 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a8483fce-cd23-4ddd-9a03-bd87903b364b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:22.802769 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a8483fce-cd23-4ddd-9a03-bd87903b364b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:22.803412 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a8483fce-cd23-4ddd-9a03-bd87903b364b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:23.091161 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-efe08d5a-0cbe-48e7-a984-1082564884fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.330262 Aug 30 07:50:23.091803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 247/450] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:22 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:23.096834 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-46466562-ee56-4b72-83aa-0deae902337b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:23.097533 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-46466562-ee56-4b72-83aa-0deae902337b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:23.103877 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-46466562-ee56-4b72-83aa-0deae902337b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:23.104323 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-46466562-ee56-4b72-83aa-0deae902337b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:23.105086 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-46466562-ee56-4b72-83aa-0deae902337b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:23.105521 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-46466562-ee56-4b72-83aa-0deae902337b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:23.114870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a8483fce-cd23-4ddd-9a03-bd87903b364b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 26968 microversion: 2.20 time: 0.325369 Aug 30 07:50:23.115668 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 204/451] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:22 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 26968 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:50:23.122387 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9c7b7719-3240-4285-8411-849be3cb30f4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:23.123101 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9c7b7719-3240-4285-8411-849be3cb30f4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:23.130970 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9c7b7719-3240-4285-8411-849be3cb30f4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:23.131753 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9c7b7719-3240-4285-8411-849be3cb30f4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:23.133181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9c7b7719-3240-4285-8411-849be3cb30f4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:23.133616 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9c7b7719-3240-4285-8411-849be3cb30f4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:23.265704 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-46466562-ee56-4b72-83aa-0deae902337b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:23.274001 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-46466562-ee56-4b72-83aa-0deae902337b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1502 microversion: 2.1 time: 0.180689 Aug 30 07:50:23.281841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 248/452] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:23 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:23.282241 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9c7b7719-3240-4285-8411-849be3cb30f4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:23.286953 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9c7b7719-3240-4285-8411-849be3cb30f4 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.170115 Aug 30 07:50:23.287752 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 205/453] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:23 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:24.103411 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3ab469c4-fb1f-4e55-a9f1-4947e36a4564 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:24.104383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3ab469c4-fb1f-4e55-a9f1-4947e36a4564 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:24.110639 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ab469c4-fb1f-4e55-a9f1-4947e36a4564 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:24.111082 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ab469c4-fb1f-4e55-a9f1-4947e36a4564 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:24.111841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ab469c4-fb1f-4e55-a9f1-4947e36a4564 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:24.112271 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ab469c4-fb1f-4e55-a9f1-4947e36a4564 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:24.128093 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0b21ac6b-1458-4f8d-a728-6f501b45d37a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:24.129006 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0b21ac6b-1458-4f8d-a728-6f501b45d37a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:24.136048 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0b21ac6b-1458-4f8d-a728-6f501b45d37a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:24.136497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0b21ac6b-1458-4f8d-a728-6f501b45d37a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:24.137269 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0b21ac6b-1458-4f8d-a728-6f501b45d37a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:24.137691 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0b21ac6b-1458-4f8d-a728-6f501b45d37a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:29.312355 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0b21ac6b-1458-4f8d-a728-6f501b45d37a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 27762 microversion: 2.20 time: 5.188087 Aug 30 07:50:29.313019 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 206/454] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:24 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 27762 bytes in 5190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:50:29.317919 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a5081514-d414-4b19-b31c-029c79e07140 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:29.318665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a5081514-d414-4b19-b31c-029c79e07140 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:29.327647 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a5081514-d414-4b19-b31c-029c79e07140 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:29.328150 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a5081514-d414-4b19-b31c-029c79e07140 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:29.329243 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a5081514-d414-4b19-b31c-029c79e07140 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:29.329683 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a5081514-d414-4b19-b31c-029c79e07140 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:29.334814 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3ab469c4-fb1f-4e55-a9f1-4947e36a4564 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 5.235331 Aug 30 07:50:29.336632 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 249/455] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:24 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 5238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:29.344072 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dd55c704-b222-4c09-9fa8-9bf12bf7f7f2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:29.345268 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dd55c704-b222-4c09-9fa8-9bf12bf7f7f2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:29.354590 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd55c704-b222-4c09-9fa8-9bf12bf7f7f2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:29.355187 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd55c704-b222-4c09-9fa8-9bf12bf7f7f2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:29.356286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd55c704-b222-4c09-9fa8-9bf12bf7f7f2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:29.356819 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dd55c704-b222-4c09-9fa8-9bf12bf7f7f2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:29.474765 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a5081514-d414-4b19-b31c-029c79e07140 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:29.482960 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a5081514-d414-4b19-b31c-029c79e07140 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1502 microversion: 2.1 time: 0.168794 Aug 30 07:50:29.483749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 207/456] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:29 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:29.488490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-8da78d9a-b65b-42ee-9dca-eeb123a76289 req-87ace41b-47af-457a-a9b5-504a97e8c4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4452d5f-87e6-4c7e-9d92-71d489324d18", "name": "network-vif-unplugged", "status": "completed", "tag": "0c1fdca9-6459-41de-9778-c72124cf39a8"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:29.490446 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:50:29.490446 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:50:29.498655 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-8da78d9a-b65b-42ee-9dca-eeb123a76289 req-87ace41b-47af-457a-a9b5-504a97e8c4ac service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:29.499498 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-8da78d9a-b65b-42ee-9dca-eeb123a76289 req-87ace41b-47af-457a-a9b5-504a97e8c4ac service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:29.519743 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-8da78d9a-b65b-42ee-9dca-eeb123a76289 req-87ace41b-47af-457a-a9b5-504a97e8c4ac service nova] Creating event network-vif-unplugged:0c1fdca9-6459-41de-9778-c72124cf39a8 for instance a4452d5f-87e6-4c7e-9d92-71d489324d18 on hv-cinder-80619 Aug 30 07:50:29.530426 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-8da78d9a-b65b-42ee-9dca-eeb123a76289 req-87ace41b-47af-457a-a9b5-504a97e8c4ac service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045122 Aug 30 07:50:29.531031 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 208/457] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:50:29.620626 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-dd55c704-b222-4c09-9fa8-9bf12bf7f7f2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:29.628317 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dd55c704-b222-4c09-9fa8-9bf12bf7f7f2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.289763 Aug 30 07:50:29.628892 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 250/458] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:29 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:29.935736 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-36599578-a258-4176-b2b2-9d88fea6a851 req-2b7b7847-c244-4446-8d1e-c229c3d1c67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4452d5f-87e6-4c7e-9d92-71d489324d18", "name": "network-vif-deleted", "tag": "0c1fdca9-6459-41de-9778-c72124cf39a8"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:29.937273 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:50:29.937273 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:50:29.944595 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-36599578-a258-4176-b2b2-9d88fea6a851 req-2b7b7847-c244-4446-8d1e-c229c3d1c67a service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:29.945053 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-36599578-a258-4176-b2b2-9d88fea6a851 req-2b7b7847-c244-4446-8d1e-c229c3d1c67a service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:29.955591 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-36599578-a258-4176-b2b2-9d88fea6a851 req-2b7b7847-c244-4446-8d1e-c229c3d1c67a service nova] Creating event network-vif-deleted:0c1fdca9-6459-41de-9778-c72124cf39a8 for instance a4452d5f-87e6-4c7e-9d92-71d489324d18 on hv-cinder-80619 Aug 30 07:50:29.960888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-36599578-a258-4176-b2b2-9d88fea6a851 req-2b7b7847-c244-4446-8d1e-c229c3d1c67a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029137 Aug 30 07:50:29.961469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 209/459] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:50:30.325115 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-31979b44-fdf3-4301-a728-7987c4b61fa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:30.326033 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-31979b44-fdf3-4301-a728-7987c4b61fa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:30.331898 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31979b44-fdf3-4301-a728-7987c4b61fa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:30.332344 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31979b44-fdf3-4301-a728-7987c4b61fa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:30.333101 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31979b44-fdf3-4301-a728-7987c4b61fa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:30.333532 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31979b44-fdf3-4301-a728-7987c4b61fa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:30.349023 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fa0d08f0-c533-4190-b739-0d05507ca3e9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:30.350058 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fa0d08f0-c533-4190-b739-0d05507ca3e9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:30.357600 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa0d08f0-c533-4190-b739-0d05507ca3e9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:30.358053 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa0d08f0-c533-4190-b739-0d05507ca3e9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:30.358868 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa0d08f0-c533-4190-b739-0d05507ca3e9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:30.359308 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa0d08f0-c533-4190-b739-0d05507ca3e9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:30.423920 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-31979b44-fdf3-4301-a728-7987c4b61fa8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 27828 microversion: 2.20 time: 0.102356 Aug 30 07:50:30.424462 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 251/460] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:30 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 27828 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:50:30.444719 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fa0d08f0-c533-4190-b739-0d05507ca3e9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.099060 Aug 30 07:50:30.445356 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 210/461] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:30 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:50:30.501161 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7e6ccfd8-ef4f-4b0b-a03e-c087995d371f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:30.502131 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7e6ccfd8-ef4f-4b0b-a03e-c087995d371f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:30.509494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7e6ccfd8-ef4f-4b0b-a03e-c087995d371f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:30.509935 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7e6ccfd8-ef4f-4b0b-a03e-c087995d371f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:30.510718 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7e6ccfd8-ef4f-4b0b-a03e-c087995d371f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:30.511147 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7e6ccfd8-ef4f-4b0b-a03e-c087995d371f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:30.542019 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7e6ccfd8-ef4f-4b0b-a03e-c087995d371f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:30.542509 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7e6ccfd8-ef4f-4b0b-a03e-c087995d371f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:30.542962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-7e6ccfd8-ef4f-4b0b-a03e-c087995d371f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lazy-loading 'fault' on Instance uuid a4452d5f-87e6-4c7e-9d92-71d489324d18 {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:50:30.588630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7e6ccfd8-ef4f-4b0b-a03e-c087995d371f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:30.596701 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7e6ccfd8-ef4f-4b0b-a03e-c087995d371f tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 200 len: 1303 microversion: 2.1 time: 0.099435 Aug 30 07:50:30.597282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 252/462] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:30 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:30.646804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bcf2f377-bf43-4947-9db1-a942d66b9a12 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:30.646804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bcf2f377-bf43-4947-9db1-a942d66b9a12 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:30.652138 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bcf2f377-bf43-4947-9db1-a942d66b9a12 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:30.652586 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bcf2f377-bf43-4947-9db1-a942d66b9a12 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:30.653352 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bcf2f377-bf43-4947-9db1-a942d66b9a12 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:30.653782 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bcf2f377-bf43-4947-9db1-a942d66b9a12 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:30.773473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-bcf2f377-bf43-4947-9db1-a942d66b9a12 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:30.780623 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bcf2f377-bf43-4947-9db1-a942d66b9a12 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.139703 Aug 30 07:50:30.781180 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 211/463] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:30 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:31.435541 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ea6783c6-b2bd-49bd-a19d-370337582db8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:31.436385 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ea6783c6-b2bd-49bd-a19d-370337582db8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:31.442170 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea6783c6-b2bd-49bd-a19d-370337582db8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:31.442619 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea6783c6-b2bd-49bd-a19d-370337582db8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:31.443382 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea6783c6-b2bd-49bd-a19d-370337582db8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:31.443812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ea6783c6-b2bd-49bd-a19d-370337582db8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:31.455997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8f5b56c5-59ef-490d-88a8-6425261976d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:31.457053 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8f5b56c5-59ef-490d-88a8-6425261976d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:31.463896 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f5b56c5-59ef-490d-88a8-6425261976d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:31.464347 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f5b56c5-59ef-490d-88a8-6425261976d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:31.465164 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f5b56c5-59ef-490d-88a8-6425261976d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:31.465604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f5b56c5-59ef-490d-88a8-6425261976d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:31.595874 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ea6783c6-b2bd-49bd-a19d-370337582db8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 27955 microversion: 2.20 time: 0.163943 Aug 30 07:50:31.597701 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 253/464] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:31 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 27955 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:31.613010 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6f21b75d-7bf2-4439-8852-1963cf762e7b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:31.613695 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6f21b75d-7bf2-4439-8852-1963cf762e7b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: a4452d5f-87e6-4c7e-9d92-71d489324d18] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:31.620295 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8f5b56c5-59ef-490d-88a8-6425261976d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.167776 Aug 30 07:50:31.620775 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f21b75d-7bf2-4439-8852-1963cf762e7b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:31.620947 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 212/465] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:31 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:50:31.622311 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f21b75d-7bf2-4439-8852-1963cf762e7b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:31.623088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f21b75d-7bf2-4439-8852-1963cf762e7b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:31.623519 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f21b75d-7bf2-4439-8852-1963cf762e7b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:31.639080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-6f21b75d-7bf2-4439-8852-1963cf762e7b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] HTTP exception thrown: Instance a4452d5f-87e6-4c7e-9d92-71d489324d18 could not be found. Aug 30 07:50:31.639671 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6f21b75d-7bf2-4439-8852-1963cf762e7b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Returning 404 to user: Instance a4452d5f-87e6-4c7e-9d92-71d489324d18 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:50:31.640505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6f21b75d-7bf2-4439-8852-1963cf762e7b tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18" status: 404 len: 111 microversion: 2.1 time: 0.031450 Aug 30 07:50:31.641091 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 254/466] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:31 2021] GET /compute/v2.1/servers/a4452d5f-87e6-4c7e-9d92-71d489324d18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:50:31.656344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-77a6980b-2372-4a5c-a579-9e1e3a9714b1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad026f9f-5dfa-4643-bc96-48fb7448f039"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:31.657668 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-77a6980b-2372-4a5c-a579-9e1e3a9714b1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:31.665907 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-77a6980b-2372-4a5c-a579-9e1e3a9714b1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:31.666382 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-77a6980b-2372-4a5c-a579-9e1e3a9714b1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:31.667340 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-77a6980b-2372-4a5c-a579-9e1e3a9714b1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:31.667621 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-77a6980b-2372-4a5c-a579-9e1e3a9714b1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:31.776360 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-925299986", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "networks": [{"uuid": "c4d33ed9-0946-4851-a2a3-23707dea7a5f"}]}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:31.828789 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.network.neutron [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] validate_networks() for [('c4d33ed9-0946-4851-a2a3-23707dea7a5f', None, None, None, None, None)] {{(pid=114671) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:50:31.915953 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-77a6980b-2372-4a5c-a579-9e1e3a9714b1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "POST /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263792 Aug 30 07:50:31.916574 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 213/467] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:50:31 2021] POST /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:50:31.921776 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1dd7cb80-3298-4084-9d58-9f1536e22495 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:31.922410 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1dd7cb80-3298-4084-9d58-9f1536e22495 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:31.931655 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1dd7cb80-3298-4084-9d58-9f1536e22495 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:31.932111 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1dd7cb80-3298-4084-9d58-9f1536e22495 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:31.932903 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1dd7cb80-3298-4084-9d58-9f1536e22495 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:31.933343 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1dd7cb80-3298-4084-9d58-9f1536e22495 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.079924 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1dd7cb80-3298-4084-9d58-9f1536e22495 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:32.088529 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1dd7cb80-3298-4084-9d58-9f1536e22495 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1502 microversion: 2.1 time: 0.170634 Aug 30 07:50:32.089136 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 214/468] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:31 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:32.106276 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cdd8b9c8-108c-456d-80c4-f774dfca0e5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0065b15a-e982-401f-b6ef-daf8ed9f962a"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:32.107408 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-cdd8b9c8-108c-456d-80c4-f774dfca0e5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:32.113870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cdd8b9c8-108c-456d-80c4-f774dfca0e5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.114516 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cdd8b9c8-108c-456d-80c4-f774dfca0e5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.115371 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cdd8b9c8-108c-456d-80c4-f774dfca0e5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.115845 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cdd8b9c8-108c-456d-80c4-f774dfca0e5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.144356 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-cdd8b9c8-108c-456d-80c4-f774dfca0e5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] HTTP exception thrown: Cannot 'attach_volume' instance 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 while it is in vm_state rescued Aug 30 07:50:32.145194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cdd8b9c8-108c-456d-80c4-f774dfca0e5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Returning 409 to user: Cannot 'attach_volume' instance 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 while it is in vm_state rescued {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:50:32.146201 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-cdd8b9c8-108c-456d-80c4-f774dfca0e5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044340 Aug 30 07:50:32.146923 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 215/469] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:50:32 2021] POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 07:50:32.156034 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3addc90b-0f75-402c-b046-759af2a2d95c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:32.156568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3addc90b-0f75-402c-b046-759af2a2d95c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:32.163375 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3addc90b-0f75-402c-b046-759af2a2d95c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.163834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3addc90b-0f75-402c-b046-759af2a2d95c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.165491 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3addc90b-0f75-402c-b046-759af2a2d95c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.166088 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3addc90b-0f75-402c-b046-759af2a2d95c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.241514 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3addc90b-0f75-402c-b046-759af2a2d95c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/action" status: 202 len: 0 microversion: 2.1 time: 0.088284 Aug 30 07:50:32.242727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 216/470] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:32 2021] POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:50:32.246322 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Flavor limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:50:32.246852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Image limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:50:32.247453 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Flavor pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:50:32.247909 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Image pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:50:32.248420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:50:32.251775 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e56b4262-afe0-40c1-85d3-6bf750125d49 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:32.252493 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e56b4262-afe0-40c1-85d3-6bf750125d49 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:32.260187 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.260402 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e56b4262-afe0-40c1-85d3-6bf750125d49 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.260687 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e56b4262-afe0-40c1-85d3-6bf750125d49 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.261026 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.261469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e56b4262-afe0-40c1-85d3-6bf750125d49 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.262005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e56b4262-afe0-40c1-85d3-6bf750125d49 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.262536 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.262639 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.284733 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Getting quotas for project 8ef57d4aac6547848f525daced09f728. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:50:32.291651 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Getting quotas for user 7c7eed77389f443b9bad3cd1456a2bd8 and project 8ef57d4aac6547848f525daced09f728. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:50:32.304905 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Going to run 1 instances... {{(pid=114671) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:50:32.307352 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:50:32.359754 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ee23dd09-9952-439b-8955-e54455892843 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587097 Aug 30 07:50:32.360864 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 255/471] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:50:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 07:50:32.371942 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-197bbbe3-f0b6-4005-bb55-183d4cf2cbfb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:32.372661 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-197bbbe3-f0b6-4005-bb55-183d4cf2cbfb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:32.418349 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e56b4262-afe0-40c1-85d3-6bf750125d49 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:32.426056 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e56b4262-afe0-40c1-85d3-6bf750125d49 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1510 microversion: 2.1 time: 0.178884 Aug 30 07:50:32.426885 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 217/472] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:32 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:32.448679 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-197bbbe3-f0b6-4005-bb55-183d4cf2cbfb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:32.456962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-197bbbe3-f0b6-4005-bb55-183d4cf2cbfb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1213 microversion: 2.1 time: 0.089134 Aug 30 07:50:32.457966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 256/473] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:32 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:32.608047 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-37e0cd9d-32ac-4252-80ca-26229976799e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:32.608927 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-37e0cd9d-32ac-4252-80ca-26229976799e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:32.616630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-37e0cd9d-32ac-4252-80ca-26229976799e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.617339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-37e0cd9d-32ac-4252-80ca-26229976799e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.618510 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-37e0cd9d-32ac-4252-80ca-26229976799e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.619105 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-37e0cd9d-32ac-4252-80ca-26229976799e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.632966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a4ec8a1b-7df0-4753-873c-49b94d4472d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:32.636090 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a4ec8a1b-7df0-4753-873c-49b94d4472d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:32.652018 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a4ec8a1b-7df0-4753-873c-49b94d4472d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.653362 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a4ec8a1b-7df0-4753-873c-49b94d4472d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.655165 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a4ec8a1b-7df0-4753-873c-49b94d4472d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:32.657847 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a4ec8a1b-7df0-4753-873c-49b94d4472d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:32.817834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-37e0cd9d-32ac-4252-80ca-26229976799e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 27955 microversion: 2.20 time: 0.213563 Aug 30 07:50:32.819585 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 218/474] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:32 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 27955 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:32.856635 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a4ec8a1b-7df0-4753-873c-49b94d4472d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.228195 Aug 30 07:50:32.857377 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 257/475] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:32 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:33.444842 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f05fda7f-d0fa-4a08-92b2-c996df1a1877 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:33.445543 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f05fda7f-d0fa-4a08-92b2-c996df1a1877 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:33.452007 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f05fda7f-d0fa-4a08-92b2-c996df1a1877 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:33.452454 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f05fda7f-d0fa-4a08-92b2-c996df1a1877 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:33.453221 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f05fda7f-d0fa-4a08-92b2-c996df1a1877 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:33.453751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f05fda7f-d0fa-4a08-92b2-c996df1a1877 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:33.474858 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d5b6d397-5157-4b7c-a0a4-88e84580ceed tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:33.476198 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d5b6d397-5157-4b7c-a0a4-88e84580ceed tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:33.483192 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d5b6d397-5157-4b7c-a0a4-88e84580ceed tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:33.483680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d5b6d397-5157-4b7c-a0a4-88e84580ceed tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:33.484527 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d5b6d397-5157-4b7c-a0a4-88e84580ceed tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:33.484991 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d5b6d397-5157-4b7c-a0a4-88e84580ceed tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:33.550051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d5b6d397-5157-4b7c-a0a4-88e84580ceed tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:33.558019 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d5b6d397-5157-4b7c-a0a4-88e84580ceed tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1265 microversion: 2.1 time: 0.087318 Aug 30 07:50:33.558855 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 258/476] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:33 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:33.607420 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f05fda7f-d0fa-4a08-92b2-c996df1a1877 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:33.614759 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f05fda7f-d0fa-4a08-92b2-c996df1a1877 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1510 microversion: 2.1 time: 0.174844 Aug 30 07:50:33.615401 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 219/477] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:33 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:33.830214 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a768a07f-7289-4716-aa02-9132325718b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:33.831056 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a768a07f-7289-4716-aa02-9132325718b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:33.837798 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a768a07f-7289-4716-aa02-9132325718b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:33.838272 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a768a07f-7289-4716-aa02-9132325718b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:33.839044 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a768a07f-7289-4716-aa02-9132325718b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:33.839468 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a768a07f-7289-4716-aa02-9132325718b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:33.868597 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f781d9a0-60f6-43aa-9f88-62ba1d86a6b4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:33.869524 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f781d9a0-60f6-43aa-9f88-62ba1d86a6b4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:33.875477 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f781d9a0-60f6-43aa-9f88-62ba1d86a6b4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:33.875929 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f781d9a0-60f6-43aa-9f88-62ba1d86a6b4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:33.876961 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f781d9a0-60f6-43aa-9f88-62ba1d86a6b4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:33.877398 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f781d9a0-60f6-43aa-9f88-62ba1d86a6b4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:37.665038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a768a07f-7289-4716-aa02-9132325718b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 27955 microversion: 2.20 time: 3.838588 Aug 30 07:50:37.671067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 259/478] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:33 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 27955 bytes in 3841 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:37.671450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f781d9a0-60f6-43aa-9f88-62ba1d86a6b4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 3.802979 Aug 30 07:50:37.671450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 220/479] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:33 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 3805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:37.672020 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-20b69672-c492-43e1-a7c7-1cee0e5723ee tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:37.672808 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-20b69672-c492-43e1-a7c7-1cee0e5723ee tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:37.677796 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e4b5be9c-ef91-4c8d-a7e6-add82d467a03 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:37.679252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e4b5be9c-ef91-4c8d-a7e6-add82d467a03 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:37.682684 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20b69672-c492-43e1-a7c7-1cee0e5723ee tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:37.683170 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20b69672-c492-43e1-a7c7-1cee0e5723ee tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:37.683957 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20b69672-c492-43e1-a7c7-1cee0e5723ee tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:37.684396 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20b69672-c492-43e1-a7c7-1cee0e5723ee tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:37.685579 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4b5be9c-ef91-4c8d-a7e6-add82d467a03 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:37.686028 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4b5be9c-ef91-4c8d-a7e6-add82d467a03 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:37.686831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4b5be9c-ef91-4c8d-a7e6-add82d467a03 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:37.687262 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4b5be9c-ef91-4c8d-a7e6-add82d467a03 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:37.748983 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-20b69672-c492-43e1-a7c7-1cee0e5723ee tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:37.756860 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-20b69672-c492-43e1-a7c7-1cee0e5723ee tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1265 microversion: 2.1 time: 0.088822 Aug 30 07:50:37.757542 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 260/480] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:37 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:37.812291 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e4b5be9c-ef91-4c8d-a7e6-add82d467a03 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:37.820157 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e4b5be9c-ef91-4c8d-a7e6-add82d467a03 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1510 microversion: 2.1 time: 0.146377 Aug 30 07:50:37.820738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 221/481] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:37 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:38.683865 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3bda9954-fe51-48d6-99ee-7bcd362fc143 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:38.688880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3bda9954-fe51-48d6-99ee-7bcd362fc143 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:38.689058 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1d6627e6-2308-4d6c-ab1c-1ed71794a25c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:38.692577 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1d6627e6-2308-4d6c-ab1c-1ed71794a25c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:38.699232 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3bda9954-fe51-48d6-99ee-7bcd362fc143 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:38.699686 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3bda9954-fe51-48d6-99ee-7bcd362fc143 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:38.700446 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3bda9954-fe51-48d6-99ee-7bcd362fc143 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:38.700866 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3bda9954-fe51-48d6-99ee-7bcd362fc143 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:38.705900 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1d6627e6-2308-4d6c-ab1c-1ed71794a25c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:38.706379 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1d6627e6-2308-4d6c-ab1c-1ed71794a25c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:38.707148 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1d6627e6-2308-4d6c-ab1c-1ed71794a25c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:38.707586 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1d6627e6-2308-4d6c-ab1c-1ed71794a25c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:38.939345 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3bda9954-fe51-48d6-99ee-7bcd362fc143 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28072 microversion: 2.20 time: 0.264365 Aug 30 07:50:38.946342 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 261/482] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:38 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28072 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:38.946547 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1d6627e6-2308-4d6c-ab1c-1ed71794a25c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.265678 Aug 30 07:50:38.946632 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d2d6e50f-7077-4804-b2d5-40d7eb3ce58c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:38.947029 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d2d6e50f-7077-4804-b2d5-40d7eb3ce58c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:38.948655 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 222/483] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:38 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:38.954225 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-78a241f5-7abe-42e2-b272-41273c4d5a87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:38.954963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d2d6e50f-7077-4804-b2d5-40d7eb3ce58c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:38.955083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-78a241f5-7abe-42e2-b272-41273c4d5a87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:38.955545 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d2d6e50f-7077-4804-b2d5-40d7eb3ce58c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:38.956322 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d2d6e50f-7077-4804-b2d5-40d7eb3ce58c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:38.956772 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d2d6e50f-7077-4804-b2d5-40d7eb3ce58c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:38.961528 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78a241f5-7abe-42e2-b272-41273c4d5a87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:38.961983 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78a241f5-7abe-42e2-b272-41273c4d5a87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:38.962802 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78a241f5-7abe-42e2-b272-41273c4d5a87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:38.963242 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78a241f5-7abe-42e2-b272-41273c4d5a87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:39.091766 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-78a241f5-7abe-42e2-b272-41273c4d5a87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:39.098953 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-78a241f5-7abe-42e2-b272-41273c4d5a87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1510 microversion: 2.1 time: 0.149079 Aug 30 07:50:39.099520 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 223/484] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:38 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:39.162371 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d2d6e50f-7077-4804-b2d5-40d7eb3ce58c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:39.169595 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d2d6e50f-7077-4804-b2d5-40d7eb3ce58c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.228503 Aug 30 07:50:39.170173 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 262/485] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:38 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:39.658642 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-cfe0677f-9791-4c5e-aaa4-1846766345a6 req-08ec7f59-76ce-4ec7-b6d2-0effb828d555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4835a080-f90c-40d1-892d-80b85def751c", "tag": "aab1ae57-5fbb-4d86-9147-9f7459ab52ce"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:39.660128 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:50:39.660128 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:50:39.667049 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-cfe0677f-9791-4c5e-aaa4-1846766345a6 req-08ec7f59-76ce-4ec7-b6d2-0effb828d555 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:39.667487 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-cfe0677f-9791-4c5e-aaa4-1846766345a6 req-08ec7f59-76ce-4ec7-b6d2-0effb828d555 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:39.678537 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-cfe0677f-9791-4c5e-aaa4-1846766345a6 req-08ec7f59-76ce-4ec7-b6d2-0effb828d555 service nova] Creating event network-changed:aab1ae57-5fbb-4d86-9147-9f7459ab52ce for instance 4835a080-f90c-40d1-892d-80b85def751c on hv-cinder-80619 Aug 30 07:50:39.683494 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-cfe0677f-9791-4c5e-aaa4-1846766345a6 req-08ec7f59-76ce-4ec7-b6d2-0effb828d555 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028374 Aug 30 07:50:39.684219 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 224/486] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:50:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:50:39.951101 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4b68987c-f3b9-4d1f-a225-9798e58dbfd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:39.952083 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4b68987c-f3b9-4d1f-a225-9798e58dbfd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:39.955994 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b57b0c14-e177-442f-ae11-d45abdfb3f0a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:39.956978 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b57b0c14-e177-442f-ae11-d45abdfb3f0a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:39.958466 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b68987c-f3b9-4d1f-a225-9798e58dbfd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:39.958910 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b68987c-f3b9-4d1f-a225-9798e58dbfd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:39.960034 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b68987c-f3b9-4d1f-a225-9798e58dbfd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:39.960480 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b68987c-f3b9-4d1f-a225-9798e58dbfd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:39.963725 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b57b0c14-e177-442f-ae11-d45abdfb3f0a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:39.964176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b57b0c14-e177-442f-ae11-d45abdfb3f0a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:39.965006 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b57b0c14-e177-442f-ae11-d45abdfb3f0a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:39.965610 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b57b0c14-e177-442f-ae11-d45abdfb3f0a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:45.091479 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b57b0c14-e177-442f-ae11-d45abdfb3f0a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 5.139222 Aug 30 07:50:45.092198 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 225/487] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:39 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 5141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:50:45.097464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-630da057-fc85-4499-98a4-136b4adfd17d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:45.098282 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-630da057-fc85-4499-98a4-136b4adfd17d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:45.108684 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-630da057-fc85-4499-98a4-136b4adfd17d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:45.109651 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-630da057-fc85-4499-98a4-136b4adfd17d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:45.109935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-630da057-fc85-4499-98a4-136b4adfd17d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:45.110487 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-630da057-fc85-4499-98a4-136b4adfd17d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:45.111174 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4b68987c-f3b9-4d1f-a225-9798e58dbfd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28072 microversion: 2.20 time: 5.161152 Aug 30 07:50:45.113291 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 263/488] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:39 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28072 bytes in 5166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:45.125446 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0045ae81-edfd-46d3-ae21-114c5991b623 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:45.126796 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0045ae81-edfd-46d3-ae21-114c5991b623 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:45.135636 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0045ae81-edfd-46d3-ae21-114c5991b623 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:45.136070 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0045ae81-edfd-46d3-ae21-114c5991b623 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:45.136860 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0045ae81-edfd-46d3-ae21-114c5991b623 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:45.137299 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0045ae81-edfd-46d3-ae21-114c5991b623 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:45.244119 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-630da057-fc85-4499-98a4-136b4adfd17d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:45.251827 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-630da057-fc85-4499-98a4-136b4adfd17d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1510 microversion: 2.1 time: 0.158363 Aug 30 07:50:45.252406 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 226/489] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:45 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:45.361863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0045ae81-edfd-46d3-ae21-114c5991b623 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:45.369555 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0045ae81-edfd-46d3-ae21-114c5991b623 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.254550 Aug 30 07:50:45.370129 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 264/490] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:45 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:46.104259 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-eeb232df-f009-4dfb-a288-3b792342fbde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:46.105203 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-eeb232df-f009-4dfb-a288-3b792342fbde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:46.112410 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eeb232df-f009-4dfb-a288-3b792342fbde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:46.112980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eeb232df-f009-4dfb-a288-3b792342fbde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:46.113758 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eeb232df-f009-4dfb-a288-3b792342fbde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:46.114238 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eeb232df-f009-4dfb-a288-3b792342fbde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:46.123462 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-aa22b6cd-6183-42eb-bb2c-fb1cc1adce4a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:46.124396 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-aa22b6cd-6183-42eb-bb2c-fb1cc1adce4a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:46.132094 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa22b6cd-6183-42eb-bb2c-fb1cc1adce4a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:46.132531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa22b6cd-6183-42eb-bb2c-fb1cc1adce4a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:46.133662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa22b6cd-6183-42eb-bb2c-fb1cc1adce4a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:46.134116 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa22b6cd-6183-42eb-bb2c-fb1cc1adce4a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:46.814521 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-aa22b6cd-6183-42eb-bb2c-fb1cc1adce4a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.694604 Aug 30 07:50:46.819016 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 265/491] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:46 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:50:46.820520 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6515f68f-6289-468f-935b-17e4290e61a1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:46.821217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6515f68f-6289-468f-935b-17e4290e61a1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:46.827490 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6515f68f-6289-468f-935b-17e4290e61a1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:46.828196 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6515f68f-6289-468f-935b-17e4290e61a1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:46.829050 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6515f68f-6289-468f-935b-17e4290e61a1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:46.829593 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6515f68f-6289-468f-935b-17e4290e61a1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:46.831964 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-eeb232df-f009-4dfb-a288-3b792342fbde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.731408 Aug 30 07:50:46.839068 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 227/492] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:46 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:46.841720 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-583ecbd9-63de-48ab-90da-0968f68c2770 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:46.843436 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-583ecbd9-63de-48ab-90da-0968f68c2770 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:46.849907 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-583ecbd9-63de-48ab-90da-0968f68c2770 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:46.850400 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-583ecbd9-63de-48ab-90da-0968f68c2770 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:46.851164 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-583ecbd9-63de-48ab-90da-0968f68c2770 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:46.851588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-583ecbd9-63de-48ab-90da-0968f68c2770 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:46.981964 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6515f68f-6289-468f-935b-17e4290e61a1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:46.987871 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-583ecbd9-63de-48ab-90da-0968f68c2770 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:46.996493 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-583ecbd9-63de-48ab-90da-0968f68c2770 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.158629 Aug 30 07:50:46.997380 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 228/493] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:46 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:46.998981 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6515f68f-6289-468f-935b-17e4290e61a1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1510 microversion: 2.1 time: 0.182188 Aug 30 07:50:46.999926 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 266/494] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:46 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:47.826720 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7702df47-de61-4e2a-a84c-1ae8fb5540aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:47.827702 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7702df47-de61-4e2a-a84c-1ae8fb5540aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:47.833816 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7702df47-de61-4e2a-a84c-1ae8fb5540aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:47.834423 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7702df47-de61-4e2a-a84c-1ae8fb5540aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:47.835213 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7702df47-de61-4e2a-a84c-1ae8fb5540aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:47.835653 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7702df47-de61-4e2a-a84c-1ae8fb5540aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:47.846491 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4a9a4867-f903-4209-96c3-b53606ee7162 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:47.847446 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4a9a4867-f903-4209-96c3-b53606ee7162 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:47.854744 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a9a4867-f903-4209-96c3-b53606ee7162 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:47.855188 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a9a4867-f903-4209-96c3-b53606ee7162 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:47.856152 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a9a4867-f903-4209-96c3-b53606ee7162 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:47.856589 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a9a4867-f903-4209-96c3-b53606ee7162 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:47.979908 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4a9a4867-f903-4209-96c3-b53606ee7162 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28166 microversion: 2.1 time: 0.139358 Aug 30 07:50:47.980813 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 267/495] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:47 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28166 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:50:47.983064 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7702df47-de61-4e2a-a84c-1ae8fb5540aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.159910 Aug 30 07:50:47.983812 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 229/496] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:47 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:48.013534 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-04d3e641-df1b-4c3b-86d1-f107835613b2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:48.014218 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-04d3e641-df1b-4c3b-86d1-f107835613b2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:48.015832 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2d406b76-30e6-4151-a2f9-5a8e284b1558 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:48.016429 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2d406b76-30e6-4151-a2f9-5a8e284b1558 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:48.023878 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d406b76-30e6-4151-a2f9-5a8e284b1558 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:48.024331 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d406b76-30e6-4151-a2f9-5a8e284b1558 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:48.025113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d406b76-30e6-4151-a2f9-5a8e284b1558 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:48.025219 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-04d3e641-df1b-4c3b-86d1-f107835613b2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:48.025556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d406b76-30e6-4151-a2f9-5a8e284b1558 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:48.025676 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-04d3e641-df1b-4c3b-86d1-f107835613b2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:48.026456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-04d3e641-df1b-4c3b-86d1-f107835613b2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:48.026895 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-04d3e641-df1b-4c3b-86d1-f107835613b2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:48.158943 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2d406b76-30e6-4151-a2f9-5a8e284b1558 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:48.169296 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2d406b76-30e6-4151-a2f9-5a8e284b1558 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1510 microversion: 2.1 time: 0.157375 Aug 30 07:50:48.180156 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-04d3e641-df1b-4c3b-86d1-f107835613b2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:48.181029 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 230/497] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:48 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:48.189155 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-04d3e641-df1b-4c3b-86d1-f107835613b2 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.179648 Aug 30 07:50:48.190072 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 268/498] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:48 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:48.991489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-037d2188-861e-4e59-b559-0a049f353432 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:48.992407 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-037d2188-861e-4e59-b559-0a049f353432 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:48.995149 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5d6134f5-0b13-4fbe-b445-e3fb222185cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:48.996324 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5d6134f5-0b13-4fbe-b445-e3fb222185cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:48.998765 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-037d2188-861e-4e59-b559-0a049f353432 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:48.999113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-037d2188-861e-4e59-b559-0a049f353432 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:48.999954 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-037d2188-861e-4e59-b559-0a049f353432 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:49.000377 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-037d2188-861e-4e59-b559-0a049f353432 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:49.003429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d6134f5-0b13-4fbe-b445-e3fb222185cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:49.003967 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d6134f5-0b13-4fbe-b445-e3fb222185cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:49.004774 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d6134f5-0b13-4fbe-b445-e3fb222185cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:49.005206 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d6134f5-0b13-4fbe-b445-e3fb222185cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:49.174506 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-037d2188-861e-4e59-b559-0a049f353432 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28457 microversion: 2.1 time: 0.186555 Aug 30 07:50:49.175411 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 231/499] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:48 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28457 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:49.188648 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3b16bf70-bdce-43a5-9064-0807f7823b1b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:49.189346 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3b16bf70-bdce-43a5-9064-0807f7823b1b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:49.197060 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3b16bf70-bdce-43a5-9064-0807f7823b1b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:49.197606 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3b16bf70-bdce-43a5-9064-0807f7823b1b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:49.198410 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3b16bf70-bdce-43a5-9064-0807f7823b1b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:49.198846 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3b16bf70-bdce-43a5-9064-0807f7823b1b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:49.199667 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5d6134f5-0b13-4fbe-b445-e3fb222185cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.208531 Aug 30 07:50:49.202053 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 269/500] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:48 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:49.207470 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3845292c-f052-41a9-8fa7-8d777139ea39 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:49.208133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3845292c-f052-41a9-8fa7-8d777139ea39 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:49.214363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3845292c-f052-41a9-8fa7-8d777139ea39 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:49.214810 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3845292c-f052-41a9-8fa7-8d777139ea39 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:49.215591 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3845292c-f052-41a9-8fa7-8d777139ea39 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:49.216024 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3845292c-f052-41a9-8fa7-8d777139ea39 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:49.342274 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3b16bf70-bdce-43a5-9064-0807f7823b1b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:49.351607 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3b16bf70-bdce-43a5-9064-0807f7823b1b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1516 microversion: 2.1 time: 0.166652 Aug 30 07:50:49.352183 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 232/501] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:49 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:49.355764 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3845292c-f052-41a9-8fa7-8d777139ea39 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:49.370086 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3845292c-f052-41a9-8fa7-8d777139ea39 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.160631 Aug 30 07:50:49.370086 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 270/502] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:49 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:50.186843 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-98d19e17-e885-4b79-bbdb-e49850901386 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:50.187893 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-98d19e17-e885-4b79-bbdb-e49850901386 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:50.194884 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-98d19e17-e885-4b79-bbdb-e49850901386 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:50.195326 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-98d19e17-e885-4b79-bbdb-e49850901386 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:50.196095 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-98d19e17-e885-4b79-bbdb-e49850901386 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:50.196523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-98d19e17-e885-4b79-bbdb-e49850901386 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:50.211064 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8b91f8e0-ad32-47d4-9213-f0b22fa5cba7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:50.212013 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8b91f8e0-ad32-47d4-9213-f0b22fa5cba7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:50.218609 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b91f8e0-ad32-47d4-9213-f0b22fa5cba7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:50.218961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b91f8e0-ad32-47d4-9213-f0b22fa5cba7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:50.219728 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b91f8e0-ad32-47d4-9213-f0b22fa5cba7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:50.220160 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b91f8e0-ad32-47d4-9213-f0b22fa5cba7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:50.367358 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8b91f8e0-ad32-47d4-9213-f0b22fa5cba7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.159991 Aug 30 07:50:50.368227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 271/503] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:50 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:50:50.381283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-87bf5cf3-11f9-4ef6-850b-d36f74f622fb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:50.381979 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-87bf5cf3-11f9-4ef6-850b-d36f74f622fb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:50.388542 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-87bf5cf3-11f9-4ef6-850b-d36f74f622fb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:50.388991 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-87bf5cf3-11f9-4ef6-850b-d36f74f622fb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:50.389755 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-87bf5cf3-11f9-4ef6-850b-d36f74f622fb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:50.390217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-87bf5cf3-11f9-4ef6-850b-d36f74f622fb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:50.438570 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-98d19e17-e885-4b79-bbdb-e49850901386 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28457 microversion: 2.1 time: 0.255334 Aug 30 07:50:50.439313 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 233/504] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:50 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28457 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:50:50.516982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-87bf5cf3-11f9-4ef6-850b-d36f74f622fb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:50.525574 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-87bf5cf3-11f9-4ef6-850b-d36f74f622fb tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.148165 Aug 30 07:50:50.526167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 272/505] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:50 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:50:50.686742 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-379d1012-11c5-4ece-991a-510802ebbd9a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:50.687450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-379d1012-11c5-4ece-991a-510802ebbd9a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:50.694176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-379d1012-11c5-4ece-991a-510802ebbd9a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:50.694640 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-379d1012-11c5-4ece-991a-510802ebbd9a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:50.695416 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-379d1012-11c5-4ece-991a-510802ebbd9a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:50.695859 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-379d1012-11c5-4ece-991a-510802ebbd9a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:50.825855 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-379d1012-11c5-4ece-991a-510802ebbd9a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:50.833170 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-379d1012-11c5-4ece-991a-510802ebbd9a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1516 microversion: 2.1 time: 0.150347 Aug 30 07:50:50.834564 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 234/506] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:50 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:50.850243 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5186b623-de1b-4598-9c4f-53df76449692 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "341c3c39-b451-4b9b-953e-d9b115d3899f"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:50.851306 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5186b623-de1b-4598-9c4f-53df76449692 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:50.856892 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5186b623-de1b-4598-9c4f-53df76449692 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:50.857340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5186b623-de1b-4598-9c4f-53df76449692 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:50.858094 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5186b623-de1b-4598-9c4f-53df76449692 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:50.858550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5186b623-de1b-4598-9c4f-53df76449692 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:51.379208 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-78503c67-3a0e-4a36-9fda-589e3fbdb17f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:51.380252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-78503c67-3a0e-4a36-9fda-589e3fbdb17f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:51.386649 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78503c67-3a0e-4a36-9fda-589e3fbdb17f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:51.387186 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78503c67-3a0e-4a36-9fda-589e3fbdb17f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:51.388029 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78503c67-3a0e-4a36-9fda-589e3fbdb17f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:51.388599 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78503c67-3a0e-4a36-9fda-589e3fbdb17f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:51.396315 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5186b623-de1b-4598-9c4f-53df76449692 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550319 Aug 30 07:50:51.397310 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 273/507] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:50:50 2021] POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments => generated 194 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:50:51.450463 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-31150049-827f-48c4-a451-05ccfd059907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:51.451470 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-31150049-827f-48c4-a451-05ccfd059907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:51.457383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31150049-827f-48c4-a451-05ccfd059907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:51.457836 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31150049-827f-48c4-a451-05ccfd059907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:51.459170 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31150049-827f-48c4-a451-05ccfd059907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:51.459750 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31150049-827f-48c4-a451-05ccfd059907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:55.282709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-31150049-827f-48c4-a451-05ccfd059907 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 3.836161 Aug 30 07:50:55.283671 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 274/508] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:51 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 3838 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:50:55.291531 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-78503c67-3a0e-4a36-9fda-589e3fbdb17f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 3.916155 Aug 30 07:50:55.292745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 235/509] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:51 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 3918 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:50:55.294134 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c9db128d-4a38-4934-b4e2-091512f5bb47 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:55.295042 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c9db128d-4a38-4934-b4e2-091512f5bb47 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:55.303605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9db128d-4a38-4934-b4e2-091512f5bb47 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:55.304046 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9db128d-4a38-4934-b4e2-091512f5bb47 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:55.304908 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9db128d-4a38-4934-b4e2-091512f5bb47 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:55.305338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9db128d-4a38-4934-b4e2-091512f5bb47 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:55.513898 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c9db128d-4a38-4934-b4e2-091512f5bb47 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:55.521855 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c9db128d-4a38-4934-b4e2-091512f5bb47 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.236311 Aug 30 07:50:55.522677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 275/510] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:55 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:56.295555 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-369a8273-57e5-4ec7-b78f-59ce8be740be tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:56.296566 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-369a8273-57e5-4ec7-b78f-59ce8be740be tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:56.304446 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cf18ef9c-fc8b-4ffa-bd83-d36e74af96c9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:56.305002 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-369a8273-57e5-4ec7-b78f-59ce8be740be tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:56.305002 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-369a8273-57e5-4ec7-b78f-59ce8be740be tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:56.305367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cf18ef9c-fc8b-4ffa-bd83-d36e74af96c9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:56.305735 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-369a8273-57e5-4ec7-b78f-59ce8be740be tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:56.306279 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-369a8273-57e5-4ec7-b78f-59ce8be740be tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:56.314009 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cf18ef9c-fc8b-4ffa-bd83-d36e74af96c9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:56.314541 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cf18ef9c-fc8b-4ffa-bd83-d36e74af96c9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:56.315603 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cf18ef9c-fc8b-4ffa-bd83-d36e74af96c9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:56.316335 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cf18ef9c-fc8b-4ffa-bd83-d36e74af96c9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:56.468040 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cf18ef9c-fc8b-4ffa-bd83-d36e74af96c9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.167640 Aug 30 07:50:56.469703 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 276/511] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:56 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:50:56.474677 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-369a8273-57e5-4ec7-b78f-59ce8be740be tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.182880 Aug 30 07:50:56.475319 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 236/512] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:56 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:56.539370 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9c1fad99-ee3a-47b8-9617-08d116e058bd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:56.540067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9c1fad99-ee3a-47b8-9617-08d116e058bd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:56.546340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c1fad99-ee3a-47b8-9617-08d116e058bd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:56.546787 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c1fad99-ee3a-47b8-9617-08d116e058bd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:56.547651 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c1fad99-ee3a-47b8-9617-08d116e058bd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:56.548089 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c1fad99-ee3a-47b8-9617-08d116e058bd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:56.682497 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9c1fad99-ee3a-47b8-9617-08d116e058bd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:56.689979 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9c1fad99-ee3a-47b8-9617-08d116e058bd tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.154660 Aug 30 07:50:56.690571 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 277/513] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:56 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:57.398991 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-756734045", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "networks": [{"uuid": "8bbf986d-b800-482c-8c2d-425ae897d112"}]}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:57.455116 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] validate_networks() for [('8bbf986d-b800-482c-8c2d-425ae897d112', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:50:57.481187 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f3d9f913-b484-42a0-a99a-a7dbe0cd5d09 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:57.482134 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f3d9f913-b484-42a0-a99a-a7dbe0cd5d09 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:57.492951 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3d9f913-b484-42a0-a99a-a7dbe0cd5d09 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:57.493406 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3d9f913-b484-42a0-a99a-a7dbe0cd5d09 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:57.494209 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3d9f913-b484-42a0-a99a-a7dbe0cd5d09 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:57.494656 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3d9f913-b484-42a0-a99a-a7dbe0cd5d09 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:57.584978 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f3d9f913-b484-42a0-a99a-a7dbe0cd5d09 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.107175 Aug 30 07:50:57.586491 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 278/514] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:57 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:57.594554 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b1051ecb-8b7f-4e90-9632-6517c6273266 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:57.596232 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b1051ecb-8b7f-4e90-9632-6517c6273266 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:57.603559 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b1051ecb-8b7f-4e90-9632-6517c6273266 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:57.604012 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b1051ecb-8b7f-4e90-9632-6517c6273266 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:57.604789 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b1051ecb-8b7f-4e90-9632-6517c6273266 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:57.605221 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b1051ecb-8b7f-4e90-9632-6517c6273266 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:57.823000 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b1051ecb-8b7f-4e90-9632-6517c6273266 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.234635 Aug 30 07:50:57.823654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 279/515] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:57 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:57.828973 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-06e81da4-d981-4d9a-ad26-04aeb1e43bf1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad026f9f-5dfa-4643-bc96-48fb7448f039"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:57.830109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-06e81da4-d981-4d9a-ad26-04aeb1e43bf1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:57.836746 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06e81da4-d981-4d9a-ad26-04aeb1e43bf1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:57.837192 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06e81da4-d981-4d9a-ad26-04aeb1e43bf1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:57.837971 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06e81da4-d981-4d9a-ad26-04aeb1e43bf1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:57.838249 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:50:57.838429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06e81da4-d981-4d9a-ad26-04aeb1e43bf1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:57.838676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:50:57.839184 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:50:57.839653 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:50:57.840069 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:50:57.848539 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:57.848987 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:57.850378 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:57.850817 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:57.867809 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Getting quotas for project f802845196ae419e94d4aa18c6cb0344. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:50:57.872364 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Getting quotas for user 40ec2ba0f5604cda983592b6036da5ac and project f802845196ae419e94d4aa18c6cb0344. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:50:57.883612 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:50:57.886083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:50:57.923975 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-06e81da4-d981-4d9a-ad26-04aeb1e43bf1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] HTTP exception thrown: Invalid volume: volume ad026f9f-5dfa-4643-bc96-48fb7448f039 is already attached to instances: b32f1264-9680-449b-a1eb-c42ea5401715 Aug 30 07:50:57.924742 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-06e81da4-d981-4d9a-ad26-04aeb1e43bf1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Returning 400 to user: Invalid volume: volume ad026f9f-5dfa-4643-bc96-48fb7448f039 is already attached to instances: b32f1264-9680-449b-a1eb-c42ea5401715 {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:50:57.925743 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-06e81da4-d981-4d9a-ad26-04aeb1e43bf1 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "POST /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100673 Aug 30 07:50:57.926388 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 280/516] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:50:57 2021] POST /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 07:50:57.934529 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2d44e9d9-d35a-45ed-b55b-e82fbc3a3461 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540695 Aug 30 07:50:57.935167 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 237/517] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:50:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:50:57.940854 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b906e193-78f4-4616-95db-932cf6cdcb45 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:57.941485 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b906e193-78f4-4616-95db-932cf6cdcb45 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:57.947576 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-53ab4082-5796-4b38-b7df-cdbfafe98b33 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:57.948410 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-53ab4082-5796-4b38-b7df-cdbfafe98b33 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:57.967240 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b906e193-78f4-4616-95db-932cf6cdcb45 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:57.967693 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b906e193-78f4-4616-95db-932cf6cdcb45 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:57.968594 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b906e193-78f4-4616-95db-932cf6cdcb45 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:57.968892 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b906e193-78f4-4616-95db-932cf6cdcb45 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:58.015036 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-53ab4082-5796-4b38-b7df-cdbfafe98b33 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:58.022098 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-53ab4082-5796-4b38-b7df-cdbfafe98b33 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1218 microversion: 2.1 time: 0.079266 Aug 30 07:50:58.022718 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 238/518] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:57 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:58.027287 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e7bfe624-11c0-4f1f-880e-1e80fb274aa0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:58.027773 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e7bfe624-11c0-4f1f-880e-1e80fb274aa0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:58.036120 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e7bfe624-11c0-4f1f-880e-1e80fb274aa0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:58.036395 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e7bfe624-11c0-4f1f-880e-1e80fb274aa0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:58.038679 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e7bfe624-11c0-4f1f-880e-1e80fb274aa0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:58.039437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e7bfe624-11c0-4f1f-880e-1e80fb274aa0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:58.120189 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b906e193-78f4-4616-95db-932cf6cdcb45 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:58.129033 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b906e193-78f4-4616-95db-932cf6cdcb45 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.197209 Aug 30 07:50:58.138236 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 281/519] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:57 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:58.148084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-e7bfe624-11c0-4f1f-880e-1e80fb274aa0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lazy-loading 'services' on Instance uuid b32f1264-9680-449b-a1eb-c42ea5401715 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:50:58.217642 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e7bfe624-11c0-4f1f-880e-1e80fb274aa0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments/ad026f9f-5dfa-4643-bc96-48fb7448f039" status: 202 len: 0 microversion: 2.1 time: 0.193483 Aug 30 07:50:58.218259 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 239/520] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:50:58 2021] DELETE /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments/ad026f9f-5dfa-4643-bc96-48fb7448f039 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:58.227702 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ce757d51-3c7d-4105-b6ff-8f95b636c58f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:58.235376 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ce757d51-3c7d-4105-b6ff-8f95b636c58f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:58.245807 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce757d51-3c7d-4105-b6ff-8f95b636c58f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:58.246467 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce757d51-3c7d-4105-b6ff-8f95b636c58f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:58.247254 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce757d51-3c7d-4105-b6ff-8f95b636c58f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:58.247756 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce757d51-3c7d-4105-b6ff-8f95b636c58f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:58.283417 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ce757d51-3c7d-4105-b6ff-8f95b636c58f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060693 Aug 30 07:50:58.283806 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 282/521] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:50:58 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:50:58.598514 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3dccdd71-b431-464b-bbb4-96a73ef8d2da tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:58.600146 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3dccdd71-b431-464b-bbb4-96a73ef8d2da tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:58.606643 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3dccdd71-b431-464b-bbb4-96a73ef8d2da tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:58.607094 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3dccdd71-b431-464b-bbb4-96a73ef8d2da tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:58.607868 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3dccdd71-b431-464b-bbb4-96a73ef8d2da tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:58.608306 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3dccdd71-b431-464b-bbb4-96a73ef8d2da tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:58.676326 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3dccdd71-b431-464b-bbb4-96a73ef8d2da tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.081450 Aug 30 07:50:58.678496 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 240/522] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:58 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:58.839741 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-718ce76c-f83b-4c21-98d4-4cd3a0db5d96 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:58.840670 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-718ce76c-f83b-4c21-98d4-4cd3a0db5d96 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:58.847705 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-718ce76c-f83b-4c21-98d4-4cd3a0db5d96 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:58.848155 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-718ce76c-f83b-4c21-98d4-4cd3a0db5d96 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:58.849057 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-718ce76c-f83b-4c21-98d4-4cd3a0db5d96 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:58.850212 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-718ce76c-f83b-4c21-98d4-4cd3a0db5d96 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:58.956127 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-718ce76c-f83b-4c21-98d4-4cd3a0db5d96 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.121818 Aug 30 07:50:58.956826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 283/523] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:58 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:50:59.044710 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0ba9de0a-6360-45aa-8f27-0c20e4cc85b5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:59.045542 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0ba9de0a-6360-45aa-8f27-0c20e4cc85b5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:59.051958 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ba9de0a-6360-45aa-8f27-0c20e4cc85b5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:59.052457 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ba9de0a-6360-45aa-8f27-0c20e4cc85b5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:59.053278 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ba9de0a-6360-45aa-8f27-0c20e4cc85b5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:59.053728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ba9de0a-6360-45aa-8f27-0c20e4cc85b5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:59.121928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0ba9de0a-6360-45aa-8f27-0c20e4cc85b5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:59.131723 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0ba9de0a-6360-45aa-8f27-0c20e4cc85b5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1288 microversion: 2.1 time: 0.093365 Aug 30 07:50:59.132313 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 241/524] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:59 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:59.149229 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-95b9009b-2e33-4ba9-9d42-e3faa7561ead tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:59.149931 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-95b9009b-2e33-4ba9-9d42-e3faa7561ead tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:59.157396 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95b9009b-2e33-4ba9-9d42-e3faa7561ead tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:59.157843 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95b9009b-2e33-4ba9-9d42-e3faa7561ead tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:59.158951 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95b9009b-2e33-4ba9-9d42-e3faa7561ead tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:59.159493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95b9009b-2e33-4ba9-9d42-e3faa7561ead tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:59.295313 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-34d2852a-3098-4df1-9e4a-82ff272d8587 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:50:59.296348 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-34d2852a-3098-4df1-9e4a-82ff272d8587 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:59.302103 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34d2852a-3098-4df1-9e4a-82ff272d8587 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:59.302729 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34d2852a-3098-4df1-9e4a-82ff272d8587 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:59.303995 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34d2852a-3098-4df1-9e4a-82ff272d8587 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:59.304438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34d2852a-3098-4df1-9e4a-82ff272d8587 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:59.336405 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-34d2852a-3098-4df1-9e4a-82ff272d8587 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Aug 30 07:50:59.337360 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 242/525] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:50:59 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:50:59.363419 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-95b9009b-2e33-4ba9-9d42-e3faa7561ead tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:50:59.370922 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-95b9009b-2e33-4ba9-9d42-e3faa7561ead tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.226435 Aug 30 07:50:59.371430 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 284/526] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:50:59 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:50:59.688776 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b2ae0851-e69c-4bc4-ba87-61a32b377269 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:59.689710 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b2ae0851-e69c-4bc4-ba87-61a32b377269 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:59.702583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b2ae0851-e69c-4bc4-ba87-61a32b377269 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:59.703041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b2ae0851-e69c-4bc4-ba87-61a32b377269 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:59.703821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b2ae0851-e69c-4bc4-ba87-61a32b377269 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:59.704264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b2ae0851-e69c-4bc4-ba87-61a32b377269 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:59.771932 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b2ae0851-e69c-4bc4-ba87-61a32b377269 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.086301 Aug 30 07:50:59.772713 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 243/527] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:50:59 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:50:59.898281 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-9c2562d8-36b2-4d13-aee8-77bcc5636a88 req-3c040abe-5415-4d10-a053-ee34877193ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4835a080-f90c-40d1-892d-80b85def751c", "name": "network-vif-plugged", "status": "completed", "tag": "aab1ae57-5fbb-4d86-9147-9f7459ab52ce"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:59.899877 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:50:59.899877 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:50:59.912104 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-9c2562d8-36b2-4d13-aee8-77bcc5636a88 req-3c040abe-5415-4d10-a053-ee34877193ca service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:59.913116 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-9c2562d8-36b2-4d13-aee8-77bcc5636a88 req-3c040abe-5415-4d10-a053-ee34877193ca service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:59.928639 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-9c2562d8-36b2-4d13-aee8-77bcc5636a88 req-3c040abe-5415-4d10-a053-ee34877193ca service nova] Creating event network-vif-plugged:aab1ae57-5fbb-4d86-9147-9f7459ab52ce for instance 4835a080-f90c-40d1-892d-80b85def751c on hv-cinder-80619 Aug 30 07:50:59.937717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-9c2562d8-36b2-4d13-aee8-77bcc5636a88 req-3c040abe-5415-4d10-a053-ee34877193ca service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043355 Aug 30 07:50:59.938934 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 285/528] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:50:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:50:59.973170 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2df6e83d-d1de-4c38-8c2b-c526a22218bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:50:59.974398 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2df6e83d-d1de-4c38-8c2b-c526a22218bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:50:59.983056 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2df6e83d-d1de-4c38-8c2b-c526a22218bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:59.983168 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2df6e83d-d1de-4c38-8c2b-c526a22218bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:50:59.984288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2df6e83d-d1de-4c38-8c2b-c526a22218bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:50:59.984724 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2df6e83d-d1de-4c38-8c2b-c526a22218bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:00.128275 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2df6e83d-d1de-4c38-8c2b-c526a22218bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.159574 Aug 30 07:51:00.129944 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 244/529] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:50:59 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:00.152928 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f3824aec-a3a6-43d1-a9db-e7ad7cf43ab0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:00.153865 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f3824aec-a3a6-43d1-a9db-e7ad7cf43ab0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:00.166537 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3824aec-a3a6-43d1-a9db-e7ad7cf43ab0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:00.166829 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3824aec-a3a6-43d1-a9db-e7ad7cf43ab0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:00.167629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3824aec-a3a6-43d1-a9db-e7ad7cf43ab0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:00.168051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f3824aec-a3a6-43d1-a9db-e7ad7cf43ab0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:00.350785 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d8936d7b-d39d-4d5b-8aa8-47fbf8fd50f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:00.352148 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d8936d7b-d39d-4d5b-8aa8-47fbf8fd50f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:00.359379 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8936d7b-d39d-4d5b-8aa8-47fbf8fd50f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:00.360127 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8936d7b-d39d-4d5b-8aa8-47fbf8fd50f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:00.361269 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8936d7b-d39d-4d5b-8aa8-47fbf8fd50f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:00.361642 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8936d7b-d39d-4d5b-8aa8-47fbf8fd50f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:00.413365 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d8936d7b-d39d-4d5b-8aa8-47fbf8fd50f9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067413 Aug 30 07:51:00.414446 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 245/530] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:00 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:00.419648 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0fcbb8ec-837a-4585-b375-74779954cca3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:00.420404 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0fcbb8ec-837a-4585-b375-74779954cca3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:00.426526 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0fcbb8ec-837a-4585-b375-74779954cca3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:00.426980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0fcbb8ec-837a-4585-b375-74779954cca3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:00.428300 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0fcbb8ec-837a-4585-b375-74779954cca3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:00.428731 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0fcbb8ec-837a-4585-b375-74779954cca3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:00.461419 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f3824aec-a3a6-43d1-a9db-e7ad7cf43ab0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:00.473437 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f3824aec-a3a6-43d1-a9db-e7ad7cf43ab0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1318 microversion: 2.1 time: 0.328182 Aug 30 07:51:00.476492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 286/531] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:00 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:00.598062 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-e44fda5b-ec22-4e2e-8247-29a1b3747d6f req-e50533e6-6a29-4e1e-9538-89cbadcb9ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4bee8b8-41a8-4be5-92f5-b53a575f9f7e", "tag": "3afa3cbd-9ebd-4e43-865d-c8d09a8b644b"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:00.601499 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:51:00.601499 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:51:00.609337 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-e44fda5b-ec22-4e2e-8247-29a1b3747d6f req-e50533e6-6a29-4e1e-9538-89cbadcb9ded service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:00.610056 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-e44fda5b-ec22-4e2e-8247-29a1b3747d6f req-e50533e6-6a29-4e1e-9538-89cbadcb9ded service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:00.622318 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-e44fda5b-ec22-4e2e-8247-29a1b3747d6f req-e50533e6-6a29-4e1e-9538-89cbadcb9ded service nova] Creating event network-changed:3afa3cbd-9ebd-4e43-865d-c8d09a8b644b for instance d4bee8b8-41a8-4be5-92f5-b53a575f9f7e on hv-cinder-80619 Aug 30 07:51:00.633375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-e44fda5b-ec22-4e2e-8247-29a1b3747d6f req-e50533e6-6a29-4e1e-9538-89cbadcb9ded service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042204 Aug 30 07:51:00.634554 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 287/532] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:51:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:51:00.635642 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0fcbb8ec-837a-4585-b375-74779954cca3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:00.643747 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0fcbb8ec-837a-4585-b375-74779954cca3 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.228270 Aug 30 07:51:00.644405 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 246/533] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:00 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:00.784197 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-582287f4-a56e-4b5e-8f98-bb312cb7f512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:00.785506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-582287f4-a56e-4b5e-8f98-bb312cb7f512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:00.794131 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-582287f4-a56e-4b5e-8f98-bb312cb7f512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:00.794538 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-582287f4-a56e-4b5e-8f98-bb312cb7f512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:00.795600 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-582287f4-a56e-4b5e-8f98-bb312cb7f512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:00.796039 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-582287f4-a56e-4b5e-8f98-bb312cb7f512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:00.901576 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-582287f4-a56e-4b5e-8f98-bb312cb7f512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.121689 Aug 30 07:51:00.903637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 288/534] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:00 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:01.140887 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2ee2ccfc-567a-4237-a03b-a9a2044ff916 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:01.141879 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2ee2ccfc-567a-4237-a03b-a9a2044ff916 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:01.148934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2ee2ccfc-567a-4237-a03b-a9a2044ff916 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:01.149386 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2ee2ccfc-567a-4237-a03b-a9a2044ff916 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:01.150399 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2ee2ccfc-567a-4237-a03b-a9a2044ff916 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:01.150840 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2ee2ccfc-567a-4237-a03b-a9a2044ff916 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:01.235846 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2ee2ccfc-567a-4237-a03b-a9a2044ff916 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.098143 Aug 30 07:51:01.237527 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 247/535] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:01 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:01.428734 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-be12c3ac-1c6c-4f8e-8d84-508462cdb4c7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:01.429818 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-be12c3ac-1c6c-4f8e-8d84-508462cdb4c7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:01.436863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-be12c3ac-1c6c-4f8e-8d84-508462cdb4c7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:01.436863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-be12c3ac-1c6c-4f8e-8d84-508462cdb4c7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:01.437759 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-be12c3ac-1c6c-4f8e-8d84-508462cdb4c7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:01.438739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-be12c3ac-1c6c-4f8e-8d84-508462cdb4c7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:01.469429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-be12c3ac-1c6c-4f8e-8d84-508462cdb4c7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048020 Aug 30 07:51:01.470516 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 289/536] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:01 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:01.492654 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-437056b1-c4c8-470d-b0a6-31b0ee06a17a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:01.493514 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-437056b1-c4c8-470d-b0a6-31b0ee06a17a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:01.500295 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-437056b1-c4c8-470d-b0a6-31b0ee06a17a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:01.500824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-437056b1-c4c8-470d-b0a6-31b0ee06a17a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:01.501850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-437056b1-c4c8-470d-b0a6-31b0ee06a17a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:01.502390 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-437056b1-c4c8-470d-b0a6-31b0ee06a17a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:01.632165 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-437056b1-c4c8-470d-b0a6-31b0ee06a17a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:01.639446 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-437056b1-c4c8-470d-b0a6-31b0ee06a17a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1318 microversion: 2.1 time: 0.150886 Aug 30 07:51:01.640018 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 248/537] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:01 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:01.663760 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-de9de9cb-75f1-4abd-aab2-160b90805fba tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:01.664377 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-de9de9cb-75f1-4abd-aab2-160b90805fba tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:01.670580 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de9de9cb-75f1-4abd-aab2-160b90805fba tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:01.670855 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de9de9cb-75f1-4abd-aab2-160b90805fba tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:01.671624 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de9de9cb-75f1-4abd-aab2-160b90805fba tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:01.672051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de9de9cb-75f1-4abd-aab2-160b90805fba tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:01.794625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-de9de9cb-75f1-4abd-aab2-160b90805fba tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:01.801862 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-de9de9cb-75f1-4abd-aab2-160b90805fba tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1313 microversion: 2.1 time: 0.144301 Aug 30 07:51:01.802719 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 290/538] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:01 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:01.914306 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f2d48a7e-4131-4c10-b382-79046ab9a09c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:01.915239 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f2d48a7e-4131-4c10-b382-79046ab9a09c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:01.920848 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2d48a7e-4131-4c10-b382-79046ab9a09c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:01.921286 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2d48a7e-4131-4c10-b382-79046ab9a09c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:01.922042 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2d48a7e-4131-4c10-b382-79046ab9a09c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:01.922504 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2d48a7e-4131-4c10-b382-79046ab9a09c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:02.004155 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f2d48a7e-4131-4c10-b382-79046ab9a09c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.093358 Aug 30 07:51:02.004804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 249/539] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:01 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:02.248517 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-301edfdb-a4e8-4a0f-aed5-1d7d3f1a954b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:02.249523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-301edfdb-a4e8-4a0f-aed5-1d7d3f1a954b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:02.256816 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-301edfdb-a4e8-4a0f-aed5-1d7d3f1a954b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:02.257326 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-301edfdb-a4e8-4a0f-aed5-1d7d3f1a954b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:02.258081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-301edfdb-a4e8-4a0f-aed5-1d7d3f1a954b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:02.258552 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-301edfdb-a4e8-4a0f-aed5-1d7d3f1a954b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:02.417954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-301edfdb-a4e8-4a0f-aed5-1d7d3f1a954b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.173302 Aug 30 07:51:02.420317 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 291/540] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:02 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:02.481952 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cffa1184-6f6f-412e-94fb-39ef8565ed7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:02.482912 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-cffa1184-6f6f-412e-94fb-39ef8565ed7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:02.489384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cffa1184-6f6f-412e-94fb-39ef8565ed7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:02.490609 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cffa1184-6f6f-412e-94fb-39ef8565ed7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:02.491397 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cffa1184-6f6f-412e-94fb-39ef8565ed7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:02.491992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cffa1184-6f6f-412e-94fb-39ef8565ed7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:02.521997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-cffa1184-6f6f-412e-94fb-39ef8565ed7f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044226 Aug 30 07:51:02.522875 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 250/541] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:02 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:02.657619 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2758be6e-c3a2-4f26-95e7-60bfa5e724f9 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:02.658331 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2758be6e-c3a2-4f26-95e7-60bfa5e724f9 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:02.665701 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2758be6e-c3a2-4f26-95e7-60bfa5e724f9 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:02.666179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2758be6e-c3a2-4f26-95e7-60bfa5e724f9 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:02.667084 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2758be6e-c3a2-4f26-95e7-60bfa5e724f9 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:02.667581 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2758be6e-c3a2-4f26-95e7-60bfa5e724f9 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:02.793770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2758be6e-c3a2-4f26-95e7-60bfa5e724f9 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:02.801883 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2758be6e-c3a2-4f26-95e7-60bfa5e724f9 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1318 microversion: 2.1 time: 0.148777 Aug 30 07:51:02.802679 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 292/542] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:02 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:02.818595 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8b0ade41-9cf1-405e-9dad-411e42526935 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:02.819290 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8b0ade41-9cf1-405e-9dad-411e42526935 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:02.825046 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b0ade41-9cf1-405e-9dad-411e42526935 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:02.825369 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b0ade41-9cf1-405e-9dad-411e42526935 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:02.826125 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b0ade41-9cf1-405e-9dad-411e42526935 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:02.826595 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8b0ade41-9cf1-405e-9dad-411e42526935 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:02.954274 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8b0ade41-9cf1-405e-9dad-411e42526935 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:02.962387 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8b0ade41-9cf1-405e-9dad-411e42526935 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1496 microversion: 2.1 time: 0.147375 Aug 30 07:51:02.962962 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 251/543] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:02 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1496 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:03.016469 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3962855b-f5c4-40f6-b6f4-dc4028c87f8c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:03.017469 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3962855b-f5c4-40f6-b6f4-dc4028c87f8c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:03.023882 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3962855b-f5c4-40f6-b6f4-dc4028c87f8c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.024332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3962855b-f5c4-40f6-b6f4-dc4028c87f8c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.025177 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3962855b-f5c4-40f6-b6f4-dc4028c87f8c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.025577 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3962855b-f5c4-40f6-b6f4-dc4028c87f8c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.328231 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3962855b-f5c4-40f6-b6f4-dc4028c87f8c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.315203 Aug 30 07:51:03.328877 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 293/544] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:03 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:03.429589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a724d62d-df3f-4626-9ef7-6a8c8bf0aa02 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:03.430812 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a724d62d-df3f-4626-9ef7-6a8c8bf0aa02 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:03.437950 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a724d62d-df3f-4626-9ef7-6a8c8bf0aa02 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.438332 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a724d62d-df3f-4626-9ef7-6a8c8bf0aa02 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.439165 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a724d62d-df3f-4626-9ef7-6a8c8bf0aa02 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.439850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a724d62d-df3f-4626-9ef7-6a8c8bf0aa02 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.480619 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3eebb69f-ed2e-41ec-b7c8-c853ae91bb99 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:03.481282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3eebb69f-ed2e-41ec-b7c8-c853ae91bb99 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:03.496392 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3eebb69f-ed2e-41ec-b7c8-c853ae91bb99 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.497641 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3eebb69f-ed2e-41ec-b7c8-c853ae91bb99 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.498709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3eebb69f-ed2e-41ec-b7c8-c853ae91bb99 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.499221 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3eebb69f-ed2e-41ec-b7c8-c853ae91bb99 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.540959 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3eebb69f-ed2e-41ec-b7c8-c853ae91bb99 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:51:03.571779 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a724d62d-df3f-4626-9ef7-6a8c8bf0aa02 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.146194 Aug 30 07:51:03.573294 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 252/545] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:03 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:03.580929 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-358c4c8a-d48b-402a-ab01-f6c62270a5b2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:03.582596 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-358c4c8a-d48b-402a-ab01-f6c62270a5b2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:03.590932 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-358c4c8a-d48b-402a-ab01-f6c62270a5b2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.591388 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-358c4c8a-d48b-402a-ab01-f6c62270a5b2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.592179 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-358c4c8a-d48b-402a-ab01-f6c62270a5b2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.592619 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-358c4c8a-d48b-402a-ab01-f6c62270a5b2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.623714 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3eebb69f-ed2e-41ec-b7c8-c853ae91bb99 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 204 len: 0 microversion: 2.1 time: 0.147313 Aug 30 07:51:03.624477 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 294/546] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:51:03 2021] DELETE /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 07:51:03.627389 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-358c4c8a-d48b-402a-ab01-f6c62270a5b2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052112 Aug 30 07:51:03.628185 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 253/547] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:03 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:03.636476 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1bf0754f-6cb6-4332-a63c-8b8734633ee7 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:03.637281 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1bf0754f-6cb6-4332-a63c-8b8734633ee7 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:03.643181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bf0754f-6cb6-4332-a63c-8b8734633ee7 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.643583 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bf0754f-6cb6-4332-a63c-8b8734633ee7 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.644353 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bf0754f-6cb6-4332-a63c-8b8734633ee7 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.644852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bf0754f-6cb6-4332-a63c-8b8734633ee7 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.765362 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1bf0754f-6cb6-4332-a63c-8b8734633ee7 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:03.773453 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1bf0754f-6cb6-4332-a63c-8b8734633ee7 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1502 microversion: 2.1 time: 0.141185 Aug 30 07:51:03.774023 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 295/548] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:03 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1502 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:03.819697 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2e7316a6-e81f-47ac-9675-cf84fa170681 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:03.820305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2e7316a6-e81f-47ac-9675-cf84fa170681 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:03.826104 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2e7316a6-e81f-47ac-9675-cf84fa170681 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.826571 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2e7316a6-e81f-47ac-9675-cf84fa170681 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.827324 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2e7316a6-e81f-47ac-9675-cf84fa170681 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:03.827751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2e7316a6-e81f-47ac-9675-cf84fa170681 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:03.947977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2e7316a6-e81f-47ac-9675-cf84fa170681 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:03.955334 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2e7316a6-e81f-47ac-9675-cf84fa170681 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1318 microversion: 2.1 time: 0.139380 Aug 30 07:51:03.955897 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 254/549] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:03 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:04.339879 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cabb064d-489a-4595-a6d0-456822c28b4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:04.340828 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cabb064d-489a-4595-a6d0-456822c28b4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:04.347584 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cabb064d-489a-4595-a6d0-456822c28b4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:04.348027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cabb064d-489a-4595-a6d0-456822c28b4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:04.348795 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cabb064d-489a-4595-a6d0-456822c28b4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:04.349388 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cabb064d-489a-4595-a6d0-456822c28b4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:04.417198 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cabb064d-489a-4595-a6d0-456822c28b4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.080731 Aug 30 07:51:04.417844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 296/550] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:04 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:04.584457 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-440592ff-e7d7-4a46-99d4-38d60957df56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:04.585402 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-440592ff-e7d7-4a46-99d4-38d60957df56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:04.591639 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-440592ff-e7d7-4a46-99d4-38d60957df56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:04.592085 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-440592ff-e7d7-4a46-99d4-38d60957df56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:04.592844 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-440592ff-e7d7-4a46-99d4-38d60957df56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:04.593276 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-440592ff-e7d7-4a46-99d4-38d60957df56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:04.639664 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7a98eb28-9f93-4fda-85aa-2de97a40c6fc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:04.640679 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7a98eb28-9f93-4fda-85aa-2de97a40c6fc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:04.647575 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7a98eb28-9f93-4fda-85aa-2de97a40c6fc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:04.648021 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7a98eb28-9f93-4fda-85aa-2de97a40c6fc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:04.648795 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7a98eb28-9f93-4fda-85aa-2de97a40c6fc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:04.649355 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7a98eb28-9f93-4fda-85aa-2de97a40c6fc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:04.681041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-440592ff-e7d7-4a46-99d4-38d60957df56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.099999 Aug 30 07:51:04.681259 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7a98eb28-9f93-4fda-85aa-2de97a40c6fc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Aug 30 07:51:04.684870 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 297/551] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:04 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:51:04.685005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 255/552] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:04 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:04.685785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1086302453", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:04.734101 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.network.neutron [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] validate_networks() for None {{(pid=114671) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:51:04.791641 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1b949bcc-afe2-40ad-870d-ffe49642431c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:04.792368 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1b949bcc-afe2-40ad-870d-ffe49642431c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:04.798822 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b949bcc-afe2-40ad-870d-ffe49642431c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:04.799273 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b949bcc-afe2-40ad-870d-ffe49642431c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:04.800040 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b949bcc-afe2-40ad-870d-ffe49642431c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:04.800478 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b949bcc-afe2-40ad-870d-ffe49642431c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:04.929593 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1b949bcc-afe2-40ad-870d-ffe49642431c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:04.936921 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1b949bcc-afe2-40ad-870d-ffe49642431c tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1502 microversion: 2.1 time: 0.149521 Aug 30 07:51:04.937450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 256/553] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:04 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:04.972935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-49e29b31-081e-4fcc-8346-2f13cbf2d111 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:04.973553 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-49e29b31-081e-4fcc-8346-2f13cbf2d111 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:04.980258 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49e29b31-081e-4fcc-8346-2f13cbf2d111 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:04.980696 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49e29b31-081e-4fcc-8346-2f13cbf2d111 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:04.981464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49e29b31-081e-4fcc-8346-2f13cbf2d111 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:04.981900 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49e29b31-081e-4fcc-8346-2f13cbf2d111 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.015516 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Flavor limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:51:05.015938 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Image limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:51:05.016464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Flavor pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:51:05.016869 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Image pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:51:05.017315 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:51:05.027640 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.028313 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.029109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.029539 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.046297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Getting quotas for project 481725f1bdc64b708f229129a79b8326. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:51:05.050451 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Getting quotas for user ba885bf8790e4f4d9dc835b2022d4c1a and project 481725f1bdc64b708f229129a79b8326. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:51:05.061353 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Going to run 1 instances... {{(pid=114671) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:51:05.064347 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:51:05.111034 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9bbfb7e8-1809-4b61-a85f-1ed46755dc39 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.428064 Aug 30 07:51:05.112122 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 298/554] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:51:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:51:05.112726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-49e29b31-081e-4fcc-8346-2f13cbf2d111 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:05.122730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-49e29b31-081e-4fcc-8346-2f13cbf2d111 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1318 microversion: 2.1 time: 0.153096 Aug 30 07:51:05.123675 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 257/555] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:04 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:05.129885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-33f783a5-203a-49b6-82b9-e3e4365e38d7 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:05.132209 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-33f783a5-203a-49b6-82b9-e3e4365e38d7 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:05.185293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-33f783a5-203a-49b6-82b9-e3e4365e38d7 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:05.192297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-33f783a5-203a-49b6-82b9-e3e4365e38d7 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1215 microversion: 2.1 time: 0.068974 Aug 30 07:51:05.192899 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 299/556] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:05 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:05.344153 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-150b0bf6-3a8a-4e93-b4f5-3b8a340a8f91 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:05.345102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-150b0bf6-3a8a-4e93-b4f5-3b8a340a8f91 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:05.351472 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-150b0bf6-3a8a-4e93-b4f5-3b8a340a8f91 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.351947 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-150b0bf6-3a8a-4e93-b4f5-3b8a340a8f91 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.352669 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-150b0bf6-3a8a-4e93-b4f5-3b8a340a8f91 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.353134 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-150b0bf6-3a8a-4e93-b4f5-3b8a340a8f91 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.376313 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-150b0bf6-3a8a-4e93-b4f5-3b8a340a8f91 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lazy-loading 'flavor' on Instance uuid 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:51:05.429308 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1aebd7fd-0082-4566-8304-79d16efef373 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:05.430797 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1aebd7fd-0082-4566-8304-79d16efef373 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:05.438965 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1aebd7fd-0082-4566-8304-79d16efef373 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.439507 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1aebd7fd-0082-4566-8304-79d16efef373 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.440380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1aebd7fd-0082-4566-8304-79d16efef373 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.440912 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1aebd7fd-0082-4566-8304-79d16efef373 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.546616 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-150b0bf6-3a8a-4e93-b4f5-3b8a340a8f91 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/action" status: 200 len: 32 microversion: 2.1 time: 0.205937 Aug 30 07:51:05.547568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 258/557] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:05 2021] POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:51:05.558224 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a047d65f-a6d8-46af-bdc1-79d17b4c7cee tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:05.558916 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a047d65f-a6d8-46af-bdc1-79d17b4c7cee tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:05.565660 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a047d65f-a6d8-46af-bdc1-79d17b4c7cee tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.566102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a047d65f-a6d8-46af-bdc1-79d17b4c7cee tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.566902 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a047d65f-a6d8-46af-bdc1-79d17b4c7cee tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.567339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a047d65f-a6d8-46af-bdc1-79d17b4c7cee tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.595050 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1aebd7fd-0082-4566-8304-79d16efef373 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.169772 Aug 30 07:51:05.599372 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 300/558] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:05 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:51:05.694338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fca2fd6b-ddf9-4d68-bfa0-30c3064900a2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:05.695592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fca2fd6b-ddf9-4d68-bfa0-30c3064900a2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:05.702425 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fca2fd6b-ddf9-4d68-bfa0-30c3064900a2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.703088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fca2fd6b-ddf9-4d68-bfa0-30c3064900a2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.704500 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fca2fd6b-ddf9-4d68-bfa0-30c3064900a2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.705250 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fca2fd6b-ddf9-4d68-bfa0-30c3064900a2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.716893 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a047d65f-a6d8-46af-bdc1-79d17b4c7cee tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:05.727711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a047d65f-a6d8-46af-bdc1-79d17b4c7cee tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.173051 Aug 30 07:51:05.728611 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 259/559] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:05 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:05.735427 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-79ea4f12-5439-4f07-b59a-880b25ff847f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:05.736500 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-79ea4f12-5439-4f07-b59a-880b25ff847f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:05.742649 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fca2fd6b-ddf9-4d68-bfa0-30c3064900a2 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053273 Aug 30 07:51:05.743976 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 301/560] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:05 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:51:05.749009 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79ea4f12-5439-4f07-b59a-880b25ff847f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.750003 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79ea4f12-5439-4f07-b59a-880b25ff847f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.752017 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79ea4f12-5439-4f07-b59a-880b25ff847f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.752611 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79ea4f12-5439-4f07-b59a-880b25ff847f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.878893 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-79ea4f12-5439-4f07-b59a-880b25ff847f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.148423 Aug 30 07:51:05.881541 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 260/561] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:05 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:05.954133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2034640833", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "networks": [{"uuid": "48af5f56-a712-424c-ad52-bbe266bf5358"}]}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:05.955480 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5954eb7f-d288-4ed2-8bfd-65549523afcf tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:05.956345 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5954eb7f-d288-4ed2-8bfd-65549523afcf tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:05.966599 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5954eb7f-d288-4ed2-8bfd-65549523afcf tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.969034 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5954eb7f-d288-4ed2-8bfd-65549523afcf tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:05.973836 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5954eb7f-d288-4ed2-8bfd-65549523afcf tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:05.974547 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5954eb7f-d288-4ed2-8bfd-65549523afcf tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.017184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.network.neutron [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] validate_networks() for [('48af5f56-a712-424c-ad52-bbe266bf5358', None, None, None, None, None)] {{(pid=114671) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:51:06.200421 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5954eb7f-d288-4ed2-8bfd-65549523afcf tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:06.215950 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5954eb7f-d288-4ed2-8bfd-65549523afcf tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1502 microversion: 2.1 time: 0.264251 Aug 30 07:51:06.216529 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 261/562] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:05 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:06.229026 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9ecec98b-1ad2-47de-9efe-e522fb09a8d6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:06.229647 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9ecec98b-1ad2-47de-9efe-e522fb09a8d6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:06.236287 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9ecec98b-1ad2-47de-9efe-e522fb09a8d6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.236948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9ecec98b-1ad2-47de-9efe-e522fb09a8d6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.238059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9ecec98b-1ad2-47de-9efe-e522fb09a8d6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.239062 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9ecec98b-1ad2-47de-9efe-e522fb09a8d6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.706308 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9ecec98b-1ad2-47de-9efe-e522fb09a8d6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:06.714525 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9ecec98b-1ad2-47de-9efe-e522fb09a8d6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1318 microversion: 2.1 time: 0.496712 Aug 30 07:51:06.715094 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 262/563] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:06 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:06.720882 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b42f024a-2619-485a-b453-2ede9042649b tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:06.722753 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b42f024a-2619-485a-b453-2ede9042649b tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:06.729605 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b42f024a-2619-485a-b453-2ede9042649b tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.730053 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b42f024a-2619-485a-b453-2ede9042649b tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.731056 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b42f024a-2619-485a-b453-2ede9042649b tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.731754 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b42f024a-2619-485a-b453-2ede9042649b tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.775970 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Flavor limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:51:06.776505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Image limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:51:06.776911 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Flavor pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:51:06.777322 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Image pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:51:06.777783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:51:06.787757 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.788198 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.788991 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.789426 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.807172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Getting quotas for project b7540de7f257475e864b4023460d355a. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:51:06.811493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Getting quotas for user 93170b4e61c9470ba9b7ec6bb66e86e0 and project b7540de7f257475e864b4023460d355a. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:51:06.822425 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Going to run 1 instances... {{(pid=114671) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:51:06.824750 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:51:06.826822 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b42f024a-2619-485a-b453-2ede9042649b tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:06.835676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b42f024a-2619-485a-b453-2ede9042649b tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1273 microversion: 2.1 time: 0.119216 Aug 30 07:51:06.837139 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 263/564] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:06 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:06.842602 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-79dfafc5-10e2-42b4-9cd0-8213c159434c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:06.843858 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-79dfafc5-10e2-42b4-9cd0-8213c159434c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:06.850727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79dfafc5-10e2-42b4-9cd0-8213c159434c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.851283 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79dfafc5-10e2-42b4-9cd0-8213c159434c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.852710 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79dfafc5-10e2-42b4-9cd0-8213c159434c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.853307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79dfafc5-10e2-42b4-9cd0-8213c159434c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.881262 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-67965402-6e0c-4bce-bc8f-1518bca93d0f tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938370 Aug 30 07:51:06.886791 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 302/565] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:51:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:51:06.891440 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-00e7fec8-0245-4cb4-ab69-5d6a14dde706 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:06.892236 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-00e7fec8-0245-4cb4-ab69-5d6a14dde706 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:06.899124 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-00e7fec8-0245-4cb4-ab69-5d6a14dde706 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.899803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-00e7fec8-0245-4cb4-ab69-5d6a14dde706 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.901098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-00e7fec8-0245-4cb4-ab69-5d6a14dde706 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.903351 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-00e7fec8-0245-4cb4-ab69-5d6a14dde706 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.980696 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-79dfafc5-10e2-42b4-9cd0-8213c159434c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.141644 Aug 30 07:51:06.981552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 264/566] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:06 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:06.987866 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e2addede-0ffe-4e91-9ec4-a7a29c272757 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:06.989000 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e2addede-0ffe-4e91-9ec4-a7a29c272757 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:06.997454 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e2addede-0ffe-4e91-9ec4-a7a29c272757 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.997913 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e2addede-0ffe-4e91-9ec4-a7a29c272757 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:06.999247 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e2addede-0ffe-4e91-9ec4-a7a29c272757 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:06.999957 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e2addede-0ffe-4e91-9ec4-a7a29c272757 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:07.083151 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-00e7fec8-0245-4cb4-ab69-5d6a14dde706 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:07.093803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-00e7fec8-0245-4cb4-ab69-5d6a14dde706 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.210229 Aug 30 07:51:07.094631 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 303/567] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:06 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:07.100435 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-06357fa5-841c-4f88-b37d-17ed3c8b2f71 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:07.101358 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-06357fa5-841c-4f88-b37d-17ed3c8b2f71 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:07.131628 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e2addede-0ffe-4e91-9ec4-a7a29c272757 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.148285 Aug 30 07:51:07.132380 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 265/568] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:06 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:07.141035 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-ec6a7ca2-a8cf-4709-ae23-7cce520f4672 req-63e47a2d-8f9f-4df7-8a6c-851cc3a0813e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4835a080-f90c-40d1-892d-80b85def751c", "name": "network-vif-deleted", "tag": "aab1ae57-5fbb-4d86-9147-9f7459ab52ce"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:07.142738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:51:07.142738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:51:07.164414 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-ec6a7ca2-a8cf-4709-ae23-7cce520f4672 req-63e47a2d-8f9f-4df7-8a6c-851cc3a0813e service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:07.164855 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-ec6a7ca2-a8cf-4709-ae23-7cce520f4672 req-63e47a2d-8f9f-4df7-8a6c-851cc3a0813e service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:07.185560 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-ec6a7ca2-a8cf-4709-ae23-7cce520f4672 req-63e47a2d-8f9f-4df7-8a6c-851cc3a0813e service nova] Creating event network-vif-deleted:aab1ae57-5fbb-4d86-9147-9f7459ab52ce for instance 4835a080-f90c-40d1-892d-80b85def751c on hv-cinder-80619 Aug 30 07:51:07.190948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-ec6a7ca2-a8cf-4709-ae23-7cce520f4672 req-63e47a2d-8f9f-4df7-8a6c-851cc3a0813e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057098 Aug 30 07:51:07.191541 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 266/569] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:51:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:07.191938 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-06357fa5-841c-4f88-b37d-17ed3c8b2f71 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:07.198924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-06357fa5-841c-4f88-b37d-17ed3c8b2f71 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1218 microversion: 2.1 time: 0.102348 Aug 30 07:51:07.199493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 304/570] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:07 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:07.233531 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fa8ea76c-afc0-44ee-a706-be9b1ec9ee70 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:07.234343 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fa8ea76c-afc0-44ee-a706-be9b1ec9ee70 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:07.241163 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa8ea76c-afc0-44ee-a706-be9b1ec9ee70 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:07.241721 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa8ea76c-afc0-44ee-a706-be9b1ec9ee70 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:07.242627 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa8ea76c-afc0-44ee-a706-be9b1ec9ee70 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:07.243204 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa8ea76c-afc0-44ee-a706-be9b1ec9ee70 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:07.278248 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa8ea76c-afc0-44ee-a706-be9b1ec9ee70 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:07.278694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa8ea76c-afc0-44ee-a706-be9b1ec9ee70 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:07.279141 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-fa8ea76c-afc0-44ee-a706-be9b1ec9ee70 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lazy-loading 'fault' on Instance uuid 4835a080-f90c-40d1-892d-80b85def751c {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:51:07.361579 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-fa8ea76c-afc0-44ee-a706-be9b1ec9ee70 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7eed77389f443b9bad3cd1456a2bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef57d4aac6547848f525daced09f728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:07.369168 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fa8ea76c-afc0-44ee-a706-be9b1ec9ee70 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 200 len: 1303 microversion: 2.1 time: 0.139999 Aug 30 07:51:07.369761 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 267/571] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:07 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:07.731754 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-970ecb94-5588-4868-9b40-f14b9efdbd63 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:07.732289 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-970ecb94-5588-4868-9b40-f14b9efdbd63 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:07.745563 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-970ecb94-5588-4868-9b40-f14b9efdbd63 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:07.746473 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-970ecb94-5588-4868-9b40-f14b9efdbd63 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:07.747605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-970ecb94-5588-4868-9b40-f14b9efdbd63 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:07.748252 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-970ecb94-5588-4868-9b40-f14b9efdbd63 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:07.854824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0dc20961-3481-447e-af9a-49f57c906976 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:07.855748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0dc20961-3481-447e-af9a-49f57c906976 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:07.863543 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0dc20961-3481-447e-af9a-49f57c906976 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:07.863984 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0dc20961-3481-447e-af9a-49f57c906976 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:07.865509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0dc20961-3481-447e-af9a-49f57c906976 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:07.865944 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0dc20961-3481-447e-af9a-49f57c906976 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:07.916753 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-970ecb94-5588-4868-9b40-f14b9efdbd63 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:07.924511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-970ecb94-5588-4868-9b40-f14b9efdbd63 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1318 microversion: 2.1 time: 0.197553 Aug 30 07:51:07.925224 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 305/572] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:07 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:07.992863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-96483979-653a-4ec6-a492-e858def190d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:07.993761 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-96483979-653a-4ec6-a492-e858def190d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:07.999808 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96483979-653a-4ec6-a492-e858def190d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.000266 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96483979-653a-4ec6-a492-e858def190d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:08.001033 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96483979-653a-4ec6-a492-e858def190d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.001464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96483979-653a-4ec6-a492-e858def190d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:08.070934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0dc20961-3481-447e-af9a-49f57c906976 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:08.078567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0dc20961-3481-447e-af9a-49f57c906976 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.229509 Aug 30 07:51:08.079159 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 268/573] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:07 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:08.091812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-96483979-653a-4ec6-a492-e858def190d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.102763 Aug 30 07:51:08.097667 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 306/574] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:07 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:51:08.111076 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f979c097-d7e4-48cd-8740-8750a38d7b95 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:08.112002 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f979c097-d7e4-48cd-8740-8750a38d7b95 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:08.120207 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f979c097-d7e4-48cd-8740-8750a38d7b95 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.120791 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f979c097-d7e4-48cd-8740-8750a38d7b95 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:08.121666 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f979c097-d7e4-48cd-8740-8750a38d7b95 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.122344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f979c097-d7e4-48cd-8740-8750a38d7b95 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:08.145390 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e2d03261-691d-4557-9e00-94b870f59566 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:08.148881 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e2d03261-691d-4557-9e00-94b870f59566 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:08.157995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e2d03261-691d-4557-9e00-94b870f59566 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.159010 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e2d03261-691d-4557-9e00-94b870f59566 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:08.160105 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e2d03261-691d-4557-9e00-94b870f59566 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.160759 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e2d03261-691d-4557-9e00-94b870f59566 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:08.251731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e2d03261-691d-4557-9e00-94b870f59566 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.111268 Aug 30 07:51:08.253960 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 307/575] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:08 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:08.260184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a99c4fcc-fcea-41b5-8da8-f2a6c1afa81d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:08.261070 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a99c4fcc-fcea-41b5-8da8-f2a6c1afa81d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:08.268794 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a99c4fcc-fcea-41b5-8da8-f2a6c1afa81d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.269516 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a99c4fcc-fcea-41b5-8da8-f2a6c1afa81d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:08.271123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a99c4fcc-fcea-41b5-8da8-f2a6c1afa81d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.272078 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a99c4fcc-fcea-41b5-8da8-f2a6c1afa81d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:08.342194 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a99c4fcc-fcea-41b5-8da8-f2a6c1afa81d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:08.353463 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a99c4fcc-fcea-41b5-8da8-f2a6c1afa81d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1288 microversion: 2.1 time: 0.097487 Aug 30 07:51:08.354053 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 308/576] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:08 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:08.387283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f27a93b1-ecab-4f72-9cda-44eaa259f003 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:08.387899 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f27a93b1-ecab-4f72-9cda-44eaa259f003 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] [instance: 4835a080-f90c-40d1-892d-80b85def751c] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:08.394915 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f27a93b1-ecab-4f72-9cda-44eaa259f003 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.396231 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f27a93b1-ecab-4f72-9cda-44eaa259f003 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:08.397406 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f27a93b1-ecab-4f72-9cda-44eaa259f003 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.398360 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f27a93b1-ecab-4f72-9cda-44eaa259f003 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:08.413810 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-f27a93b1-ecab-4f72-9cda-44eaa259f003 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] HTTP exception thrown: Instance 4835a080-f90c-40d1-892d-80b85def751c could not be found. Aug 30 07:51:08.414438 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f27a93b1-ecab-4f72-9cda-44eaa259f003 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] Returning 404 to user: Instance 4835a080-f90c-40d1-892d-80b85def751c could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:51:08.415277 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f27a93b1-ecab-4f72-9cda-44eaa259f003 tempest-VolumesActionsTest-1138931403 tempest-VolumesActionsTest-1138931403-project] 10.222.0.73 "GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c" status: 404 len: 111 microversion: 2.1 time: 0.031746 Aug 30 07:51:08.415835 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 309/577] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:08 2021] GET /compute/v2.1/servers/4835a080-f90c-40d1-892d-80b85def751c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:51:08.711602 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f979c097-d7e4-48cd-8740-8750a38d7b95 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:08.720671 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f979c097-d7e4-48cd-8740-8750a38d7b95 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.613381 Aug 30 07:51:08.721533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 269/578] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:08 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:08.952904 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-315e6df8-ff83-4881-9c79-1b0b19ea1421 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:08.953716 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-315e6df8-ff83-4881-9c79-1b0b19ea1421 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:08.971260 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-315e6df8-ff83-4881-9c79-1b0b19ea1421 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.971719 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-315e6df8-ff83-4881-9c79-1b0b19ea1421 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:08.972778 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-315e6df8-ff83-4881-9c79-1b0b19ea1421 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:08.973802 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-315e6df8-ff83-4881-9c79-1b0b19ea1421 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.096495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c8e922fb-d1f8-4bd3-ba07-3e4e0fc6cb60 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:09.097211 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c8e922fb-d1f8-4bd3-ba07-3e4e0fc6cb60 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:09.110015 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c8e922fb-d1f8-4bd3-ba07-3e4e0fc6cb60 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:09.110614 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c8e922fb-d1f8-4bd3-ba07-3e4e0fc6cb60 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.117843 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c8e922fb-d1f8-4bd3-ba07-3e4e0fc6cb60 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:09.118620 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c8e922fb-d1f8-4bd3-ba07-3e4e0fc6cb60 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.150015 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-315e6df8-ff83-4881-9c79-1b0b19ea1421 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:09.162189 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-315e6df8-ff83-4881-9c79-1b0b19ea1421 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1318 microversion: 2.1 time: 0.223970 Aug 30 07:51:09.162893 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 310/579] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:08 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:09.178320 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-47c05e2e-0247-466b-9337-ca12fe083ef6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:09.179242 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-47c05e2e-0247-466b-9337-ca12fe083ef6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:09.185275 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-47c05e2e-0247-466b-9337-ca12fe083ef6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:09.185947 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-47c05e2e-0247-466b-9337-ca12fe083ef6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.186783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-47c05e2e-0247-466b-9337-ca12fe083ef6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:09.187186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-47c05e2e-0247-466b-9337-ca12fe083ef6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.261822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-47c05e2e-0247-466b-9337-ca12fe083ef6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.086988 Aug 30 07:51:09.262459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 311/580] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:09 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:09.270486 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-b95d3a8c-ce23-45d0-90c0-3586a33c1436 req-2ade2733-80a3-4c70-94fe-972a92f193af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1701e1-f55e-495f-8464-97060e8d5448", "tag": "287d7901-2ff3-42b8-bcad-da34c85d762e"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:09.272482 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:51:09.272482 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:51:09.279767 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-b95d3a8c-ce23-45d0-90c0-3586a33c1436 req-2ade2733-80a3-4c70-94fe-972a92f193af service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:09.287797 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-b95d3a8c-ce23-45d0-90c0-3586a33c1436 req-2ade2733-80a3-4c70-94fe-972a92f193af service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.297585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-b95d3a8c-ce23-45d0-90c0-3586a33c1436 req-2ade2733-80a3-4c70-94fe-972a92f193af service nova] Creating event network-changed:287d7901-2ff3-42b8-bcad-da34c85d762e for instance ba1701e1-f55e-495f-8464-97060e8d5448 on hv-cinder-80619 Aug 30 07:51:09.303373 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-b95d3a8c-ce23-45d0-90c0-3586a33c1436 req-2ade2733-80a3-4c70-94fe-972a92f193af service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039455 Aug 30 07:51:09.303977 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 312/581] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:51:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:09.308935 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7c9ca61b-dd29-4697-911a-186d3c3a12db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:09.309925 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7c9ca61b-dd29-4697-911a-186d3c3a12db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:09.315972 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c9ca61b-dd29-4697-911a-186d3c3a12db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:09.316417 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c9ca61b-dd29-4697-911a-186d3c3a12db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.317179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c9ca61b-dd29-4697-911a-186d3c3a12db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:09.317667 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c9ca61b-dd29-4697-911a-186d3c3a12db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.436597 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c8e922fb-d1f8-4bd3-ba07-3e4e0fc6cb60 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:09.443947 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c8e922fb-d1f8-4bd3-ba07-3e4e0fc6cb60 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.351639 Aug 30 07:51:09.444536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 270/582] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:09 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:09.453365 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-811b3215-2053-40af-8173-84b56dc5e729 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:09.453365 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-811b3215-2053-40af-8173-84b56dc5e729 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:09.455143 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-811b3215-2053-40af-8173-84b56dc5e729 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:09.455621 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-811b3215-2053-40af-8173-84b56dc5e729 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.456388 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-811b3215-2053-40af-8173-84b56dc5e729 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:09.456823 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-811b3215-2053-40af-8173-84b56dc5e729 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.476136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7c9ca61b-dd29-4697-911a-186d3c3a12db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.170586 Aug 30 07:51:09.477288 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 313/583] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:09 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:09.569814 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-811b3215-2053-40af-8173-84b56dc5e729 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:09.577769 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-811b3215-2053-40af-8173-84b56dc5e729 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1276 microversion: 2.1 time: 0.132073 Aug 30 07:51:09.578543 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 271/584] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:09 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:09.740883 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d6e7def8-86db-4b8d-9187-b0831cf2a1c6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:09.742093 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d6e7def8-86db-4b8d-9187-b0831cf2a1c6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:09.749808 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6e7def8-86db-4b8d-9187-b0831cf2a1c6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:09.750371 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6e7def8-86db-4b8d-9187-b0831cf2a1c6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.751223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6e7def8-86db-4b8d-9187-b0831cf2a1c6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:09.751728 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6e7def8-86db-4b8d-9187-b0831cf2a1c6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:09.896290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d6e7def8-86db-4b8d-9187-b0831cf2a1c6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:09.905075 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d6e7def8-86db-4b8d-9187-b0831cf2a1c6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.170249 Aug 30 07:51:09.905854 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 314/585] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:09 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:09.998962 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-f6478ab7-7f10-424d-807e-10b94408fc1a req-cfe896fc-40aa-4819-9305-b9517b66c2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bee8b8-41a8-4be5-92f5-b53a575f9f7e", "name": "network-vif-plugged", "status": "completed", "tag": "3afa3cbd-9ebd-4e43-865d-c8d09a8b644b"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:10.001070 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:51:10.001070 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:51:10.008909 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-f6478ab7-7f10-424d-807e-10b94408fc1a req-cfe896fc-40aa-4819-9305-b9517b66c2b1 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:10.009517 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-f6478ab7-7f10-424d-807e-10b94408fc1a req-cfe896fc-40aa-4819-9305-b9517b66c2b1 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:10.022414 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-f6478ab7-7f10-424d-807e-10b94408fc1a req-cfe896fc-40aa-4819-9305-b9517b66c2b1 service nova] Creating event network-vif-plugged:3afa3cbd-9ebd-4e43-865d-c8d09a8b644b for instance d4bee8b8-41a8-4be5-92f5-b53a575f9f7e on hv-cinder-80619 Aug 30 07:51:10.028283 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-f6478ab7-7f10-424d-807e-10b94408fc1a req-cfe896fc-40aa-4819-9305-b9517b66c2b1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033092 Aug 30 07:51:10.029284 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 272/586] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:51:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:10.179617 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2f118205-e525-40f3-a4b3-3270dab3f4ae tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:10.180230 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2f118205-e525-40f3-a4b3-3270dab3f4ae tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:10.185865 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f118205-e525-40f3-a4b3-3270dab3f4ae tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:10.186342 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f118205-e525-40f3-a4b3-3270dab3f4ae tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:10.187108 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f118205-e525-40f3-a4b3-3270dab3f4ae tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:10.187532 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f118205-e525-40f3-a4b3-3270dab3f4ae tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:10.274709 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c5c97298-c545-4645-a761-2fac264d8bbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:10.275716 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c5c97298-c545-4645-a761-2fac264d8bbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:10.287995 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5c97298-c545-4645-a761-2fac264d8bbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:10.288450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5c97298-c545-4645-a761-2fac264d8bbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:10.289230 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5c97298-c545-4645-a761-2fac264d8bbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:10.289665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5c97298-c545-4645-a761-2fac264d8bbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:10.320497 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2f118205-e525-40f3-a4b3-3270dab3f4ae tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:10.328027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2f118205-e525-40f3-a4b3-3270dab3f4ae tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1318 microversion: 2.1 time: 0.152645 Aug 30 07:51:10.328600 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 315/587] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:10 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:10.461036 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-06038ba7-c708-47c4-ba80-6f1b07bd5a40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:10.461722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-06038ba7-c708-47c4-ba80-6f1b07bd5a40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:10.467561 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06038ba7-c708-47c4-ba80-6f1b07bd5a40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:10.468011 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06038ba7-c708-47c4-ba80-6f1b07bd5a40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:10.468779 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06038ba7-c708-47c4-ba80-6f1b07bd5a40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:10.469216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06038ba7-c708-47c4-ba80-6f1b07bd5a40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:10.594805 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-06038ba7-c708-47c4-ba80-6f1b07bd5a40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:10.602503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-06038ba7-c708-47c4-ba80-6f1b07bd5a40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.145420 Aug 30 07:51:10.603094 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 316/588] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:10 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:10.607374 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-978b9ca8-9ef1-4f83-a1b8-d14b3835ead9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:10.608260 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-978b9ca8-9ef1-4f83-a1b8-d14b3835ead9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:10.613812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-978b9ca8-9ef1-4f83-a1b8-d14b3835ead9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:10.615080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-978b9ca8-9ef1-4f83-a1b8-d14b3835ead9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:10.615848 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-978b9ca8-9ef1-4f83-a1b8-d14b3835ead9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:10.616304 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-978b9ca8-9ef1-4f83-a1b8-d14b3835ead9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:14.668894 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 07:51:14.669462 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: Mon Aug 30 07:51:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action (ip 10.222.0.73) !!! Aug 30 07:51:15.315548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c5c97298-c545-4645-a761-2fac264d8bbc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 5.045518 Aug 30 07:51:15.316225 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 273/589] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:10 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 5047 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:51:15.321639 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d70c67d1-3bae-4e9c-9cb4-f945dd573f76 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:15.322365 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d70c67d1-3bae-4e9c-9cb4-f945dd573f76 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:15.322503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-978b9ca8-9ef1-4f83-a1b8-d14b3835ead9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 4.718184 Aug 30 07:51:15.325346 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 317/590] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:10 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 4719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:15.328138 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8b6404ec-52fd-41fe-a4ea-68557d9c827e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:15.328940 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8b6404ec-52fd-41fe-a4ea-68557d9c827e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:15.329084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d70c67d1-3bae-4e9c-9cb4-f945dd573f76 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:15.329452 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d70c67d1-3bae-4e9c-9cb4-f945dd573f76 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:15.330244 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d70c67d1-3bae-4e9c-9cb4-f945dd573f76 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:15.330682 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d70c67d1-3bae-4e9c-9cb4-f945dd573f76 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:15.335165 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b6404ec-52fd-41fe-a4ea-68557d9c827e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:15.335652 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b6404ec-52fd-41fe-a4ea-68557d9c827e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:15.336402 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b6404ec-52fd-41fe-a4ea-68557d9c827e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:15.336829 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b6404ec-52fd-41fe-a4ea-68557d9c827e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:15.476959 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d70c67d1-3bae-4e9c-9cb4-f945dd573f76 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:15.481145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8b6404ec-52fd-41fe-a4ea-68557d9c827e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:15.484884 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d70c67d1-3bae-4e9c-9cb4-f945dd573f76 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1318 microversion: 2.1 time: 0.167394 Aug 30 07:51:15.485681 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 274/591] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:15 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:15.489343 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8b6404ec-52fd-41fe-a4ea-68557d9c827e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.164998 Aug 30 07:51:15.489921 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-14310284-b0fb-4a1f-9fd8-0c0044bf19c7 req-c38fed0a-f957-45b9-8199-6dc18f525cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178ce678-fdfa-4447-8572-f084fb7b273b", "tag": "13b629f3-ca48-4386-acd8-de3370618d1c"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:15.490541 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 318/592] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:15 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:15.494535 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0b8021a0-ea66-40fe-86cb-8138ae57a9ca tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:15.495366 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0b8021a0-ea66-40fe-86cb-8138ae57a9ca tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:15.500444 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:51:15.500444 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:51:15.501850 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0b8021a0-ea66-40fe-86cb-8138ae57a9ca tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:15.502331 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0b8021a0-ea66-40fe-86cb-8138ae57a9ca tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:15.503115 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0b8021a0-ea66-40fe-86cb-8138ae57a9ca tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:15.503542 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0b8021a0-ea66-40fe-86cb-8138ae57a9ca tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:15.508723 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-14310284-b0fb-4a1f-9fd8-0c0044bf19c7 req-c38fed0a-f957-45b9-8199-6dc18f525cd8 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:15.509210 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-14310284-b0fb-4a1f-9fd8-0c0044bf19c7 req-c38fed0a-f957-45b9-8199-6dc18f525cd8 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:15.520445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-14310284-b0fb-4a1f-9fd8-0c0044bf19c7 req-c38fed0a-f957-45b9-8199-6dc18f525cd8 service nova] Creating event network-changed:13b629f3-ca48-4386-acd8-de3370618d1c for instance 178ce678-fdfa-4447-8572-f084fb7b273b on hv-cinder-80619 Aug 30 07:51:15.526069 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-14310284-b0fb-4a1f-9fd8-0c0044bf19c7 req-c38fed0a-f957-45b9-8199-6dc18f525cd8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039474 Aug 30 07:51:15.527011 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 275/593] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:51:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:15.531883 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-46b2b737-5e3c-499f-9d85-d07d925a4d9a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:15.532600 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-46b2b737-5e3c-499f-9d85-d07d925a4d9a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:15.539608 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46b2b737-5e3c-499f-9d85-d07d925a4d9a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:15.540058 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46b2b737-5e3c-499f-9d85-d07d925a4d9a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:15.540838 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46b2b737-5e3c-499f-9d85-d07d925a4d9a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:15.541275 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46b2b737-5e3c-499f-9d85-d07d925a4d9a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:15.645560 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0b8021a0-ea66-40fe-86cb-8138ae57a9ca tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:15.654102 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0b8021a0-ea66-40fe-86cb-8138ae57a9ca tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1318 microversion: 2.1 time: 0.162768 Aug 30 07:51:15.655030 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 319/594] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:15 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:15.745255 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-46b2b737-5e3c-499f-9d85-d07d925a4d9a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:15.752734 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-46b2b737-5e3c-499f-9d85-d07d925a4d9a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.224575 Aug 30 07:51:15.753300 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 276/595] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:15 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:16.327558 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c8b6f379-13f3-47fe-81b1-1be061375ab4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:16.329137 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c8b6f379-13f3-47fe-81b1-1be061375ab4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:16.334478 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ee8e5cb6-a671-4533-8ca4-e5117be4a2a1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:16.335668 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ee8e5cb6-a671-4533-8ca4-e5117be4a2a1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:16.342635 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ee8e5cb6-a671-4533-8ca4-e5117be4a2a1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.343376 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ee8e5cb6-a671-4533-8ca4-e5117be4a2a1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:16.344321 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c8b6f379-13f3-47fe-81b1-1be061375ab4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.344608 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ee8e5cb6-a671-4533-8ca4-e5117be4a2a1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.344766 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c8b6f379-13f3-47fe-81b1-1be061375ab4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:16.345298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ee8e5cb6-a671-4533-8ca4-e5117be4a2a1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:16.345733 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c8b6f379-13f3-47fe-81b1-1be061375ab4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.346399 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c8b6f379-13f3-47fe-81b1-1be061375ab4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:16.757719 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ee8e5cb6-a671-4533-8ca4-e5117be4a2a1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.427321 Aug 30 07:51:16.762333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c8b6f379-13f3-47fe-81b1-1be061375ab4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.430029 Aug 30 07:51:16.763767 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 320/596] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:16 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:16.766723 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 277/597] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:16 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:16.769036 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-67a0ac63-bbfc-4134-a03a-7589a18d0947 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:16.769740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-67a0ac63-bbfc-4134-a03a-7589a18d0947 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:16.776957 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-af27e3a4-1a3c-4874-bbc7-241cf66d18b3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:16.777659 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-af27e3a4-1a3c-4874-bbc7-241cf66d18b3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:16.784552 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af27e3a4-1a3c-4874-bbc7-241cf66d18b3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.785258 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af27e3a4-1a3c-4874-bbc7-241cf66d18b3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:16.786604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-67a0ac63-bbfc-4134-a03a-7589a18d0947 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.786851 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af27e3a4-1a3c-4874-bbc7-241cf66d18b3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.786960 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-67a0ac63-bbfc-4134-a03a-7589a18d0947 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:16.787350 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af27e3a4-1a3c-4874-bbc7-241cf66d18b3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:16.787741 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-67a0ac63-bbfc-4134-a03a-7589a18d0947 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.788174 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-67a0ac63-bbfc-4134-a03a-7589a18d0947 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:16.931051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-af27e3a4-1a3c-4874-bbc7-241cf66d18b3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:16.931441 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-67a0ac63-bbfc-4134-a03a-7589a18d0947 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:16.935227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-67a0ac63-bbfc-4134-a03a-7589a18d0947 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.169958 Aug 30 07:51:16.935821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 278/598] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:16 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:16.939711 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-af27e3a4-1a3c-4874-bbc7-241cf66d18b3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1318 microversion: 2.1 time: 0.166671 Aug 30 07:51:16.950757 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2402f336-8a44-45c4-a89a-e13b68e71b64 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:16.951331 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 321/599] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:16 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:16.951465 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2402f336-8a44-45c4-a89a-e13b68e71b64 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:16.957562 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2402f336-8a44-45c4-a89a-e13b68e71b64 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.959321 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2402f336-8a44-45c4-a89a-e13b68e71b64 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:16.959533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2402f336-8a44-45c4-a89a-e13b68e71b64 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.959787 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2402f336-8a44-45c4-a89a-e13b68e71b64 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:16.968481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ef690964-4fda-4177-8d01-f00186bf6849 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:16.969317 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ef690964-4fda-4177-8d01-f00186bf6849 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:16.976089 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ef690964-4fda-4177-8d01-f00186bf6849 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.976791 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ef690964-4fda-4177-8d01-f00186bf6849 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:16.977915 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ef690964-4fda-4177-8d01-f00186bf6849 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:16.978464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ef690964-4fda-4177-8d01-f00186bf6849 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:17.101040 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2402f336-8a44-45c4-a89a-e13b68e71b64 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:17.108983 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2402f336-8a44-45c4-a89a-e13b68e71b64 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1318 microversion: 2.1 time: 0.161754 Aug 30 07:51:17.110202 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 279/600] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:16 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:17.117338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ef690964-4fda-4177-8d01-f00186bf6849 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:17.126136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ef690964-4fda-4177-8d01-f00186bf6849 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.173329 Aug 30 07:51:17.126934 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 322/601] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:16 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:17.771435 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-49790aa5-b39b-4015-831d-49b23a123322 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:17.773495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-49790aa5-b39b-4015-831d-49b23a123322 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:17.774602 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4d6b3d3d-ec80-4bc6-8f74-854d63858d3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:17.775959 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4d6b3d3d-ec80-4bc6-8f74-854d63858d3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:17.780374 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49790aa5-b39b-4015-831d-49b23a123322 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:17.780956 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49790aa5-b39b-4015-831d-49b23a123322 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:17.781838 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49790aa5-b39b-4015-831d-49b23a123322 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:17.782652 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49790aa5-b39b-4015-831d-49b23a123322 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:17.783456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d6b3d3d-ec80-4bc6-8f74-854d63858d3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:17.783899 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d6b3d3d-ec80-4bc6-8f74-854d63858d3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:17.784674 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d6b3d3d-ec80-4bc6-8f74-854d63858d3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:17.785103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d6b3d3d-ec80-4bc6-8f74-854d63858d3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:17.958359 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-49790aa5-b39b-4015-831d-49b23a123322 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.192808 Aug 30 07:51:17.960905 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 280/602] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:17 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:17.969166 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c3174629-975b-4970-88b1-9b9295ac1aa2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:17.970827 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c3174629-975b-4970-88b1-9b9295ac1aa2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:17.979096 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c3174629-975b-4970-88b1-9b9295ac1aa2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:17.979550 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c3174629-975b-4970-88b1-9b9295ac1aa2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:17.980424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c3174629-975b-4970-88b1-9b9295ac1aa2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:17.980851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c3174629-975b-4970-88b1-9b9295ac1aa2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:17.995039 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4d6b3d3d-ec80-4bc6-8f74-854d63858d3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.223699 Aug 30 07:51:17.996244 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 323/603] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:17 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:51:18.021850 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d0fc3194-eb55-4af4-9eef-23ae1c7eeb8d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:18.024278 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d0fc3194-eb55-4af4-9eef-23ae1c7eeb8d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:18.031622 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d0fc3194-eb55-4af4-9eef-23ae1c7eeb8d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:18.034169 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d0fc3194-eb55-4af4-9eef-23ae1c7eeb8d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:18.035565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d0fc3194-eb55-4af4-9eef-23ae1c7eeb8d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:18.036558 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d0fc3194-eb55-4af4-9eef-23ae1c7eeb8d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:18.169670 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c3174629-975b-4970-88b1-9b9295ac1aa2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:18.180170 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c3174629-975b-4970-88b1-9b9295ac1aa2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.219575 Aug 30 07:51:18.189757 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 281/604] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:17 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:18.189757 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f9d8d787-458c-4994-8c61-758079a811ed tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:18.189757 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f9d8d787-458c-4994-8c61-758079a811ed tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:18.210339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f9d8d787-458c-4994-8c61-758079a811ed tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:18.211028 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f9d8d787-458c-4994-8c61-758079a811ed tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:18.212364 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f9d8d787-458c-4994-8c61-758079a811ed tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:18.212364 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f9d8d787-458c-4994-8c61-758079a811ed tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:18.229093 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d0fc3194-eb55-4af4-9eef-23ae1c7eeb8d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:18.237927 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d0fc3194-eb55-4af4-9eef-23ae1c7eeb8d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1318 microversion: 2.1 time: 0.240337 Aug 30 07:51:18.240142 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 324/605] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:17 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:18.244583 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8f476807-2fee-4e52-a281-b72de058aa9e tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:18.245204 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8f476807-2fee-4e52-a281-b72de058aa9e tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:18.251858 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8f476807-2fee-4e52-a281-b72de058aa9e tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:18.252315 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8f476807-2fee-4e52-a281-b72de058aa9e tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:18.253106 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8f476807-2fee-4e52-a281-b72de058aa9e tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:18.253547 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8f476807-2fee-4e52-a281-b72de058aa9e tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:18.460863 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f9d8d787-458c-4994-8c61-758079a811ed tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:18.480357 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f9d8d787-458c-4994-8c61-758079a811ed tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1507 microversion: 2.1 time: 0.298218 Aug 30 07:51:18.481351 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 282/606] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:18 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:18.530017 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8f476807-2fee-4e52-a281-b72de058aa9e tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:18.544644 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8f476807-2fee-4e52-a281-b72de058aa9e tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.303300 Aug 30 07:51:18.555701 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 325/607] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:18 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:18.975451 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c06a3fc5-565c-4c5e-8f8e-73038ff07e54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:18.977746 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c06a3fc5-565c-4c5e-8f8e-73038ff07e54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:18.985126 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c06a3fc5-565c-4c5e-8f8e-73038ff07e54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:18.985946 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c06a3fc5-565c-4c5e-8f8e-73038ff07e54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:18.987218 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c06a3fc5-565c-4c5e-8f8e-73038ff07e54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:18.987885 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c06a3fc5-565c-4c5e-8f8e-73038ff07e54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:19.009236 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f557f493-c50b-45b5-8b36-af044d9f0de8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:19.010235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f557f493-c50b-45b5-8b36-af044d9f0de8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:19.032556 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f557f493-c50b-45b5-8b36-af044d9f0de8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:19.033018 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f557f493-c50b-45b5-8b36-af044d9f0de8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:19.037477 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f557f493-c50b-45b5-8b36-af044d9f0de8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:19.038855 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f557f493-c50b-45b5-8b36-af044d9f0de8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:19.269382 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f557f493-c50b-45b5-8b36-af044d9f0de8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.264556 Aug 30 07:51:19.272334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 326/608] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:19 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:19.278022 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4f4f78f3-be04-480a-93c2-4e75bc6d05b8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:19.278769 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4f4f78f3-be04-480a-93c2-4e75bc6d05b8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:19.285994 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4f4f78f3-be04-480a-93c2-4e75bc6d05b8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:19.287474 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4f4f78f3-be04-480a-93c2-4e75bc6d05b8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:19.288467 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4f4f78f3-be04-480a-93c2-4e75bc6d05b8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:19.289113 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4f4f78f3-be04-480a-93c2-4e75bc6d05b8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:19.299248 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c06a3fc5-565c-4c5e-8f8e-73038ff07e54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.330638 Aug 30 07:51:19.309020 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 283/609] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:18 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:19.316659 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2f4c29d6-747f-4072-b7af-10cdff50ba24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:19.319929 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2f4c29d6-747f-4072-b7af-10cdff50ba24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:19.327279 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2f4c29d6-747f-4072-b7af-10cdff50ba24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:19.328203 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2f4c29d6-747f-4072-b7af-10cdff50ba24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:19.330212 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2f4c29d6-747f-4072-b7af-10cdff50ba24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:19.330881 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2f4c29d6-747f-4072-b7af-10cdff50ba24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:19.462379 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4f4f78f3-be04-480a-93c2-4e75bc6d05b8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:19.478735 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4f4f78f3-be04-480a-93c2-4e75bc6d05b8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.204924 Aug 30 07:51:19.491405 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 327/610] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:19 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:19.571077 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ac2c0fe5-5be3-43a0-b248-c5baae1b1761 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:19.571710 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ac2c0fe5-5be3-43a0-b248-c5baae1b1761 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:19.580006 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ac2c0fe5-5be3-43a0-b248-c5baae1b1761 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:19.580389 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ac2c0fe5-5be3-43a0-b248-c5baae1b1761 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:19.581722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ac2c0fe5-5be3-43a0-b248-c5baae1b1761 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:19.582282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ac2c0fe5-5be3-43a0-b248-c5baae1b1761 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:19.589091 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2f4c29d6-747f-4072-b7af-10cdff50ba24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:19.597183 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2f4c29d6-747f-4072-b7af-10cdff50ba24 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1318 microversion: 2.1 time: 0.286299 Aug 30 07:51:19.598186 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 284/611] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:19 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:19.750561 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ac2c0fe5-5be3-43a0-b248-c5baae1b1761 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:19.762260 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ac2c0fe5-5be3-43a0-b248-c5baae1b1761 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.196131 Aug 30 07:51:19.764313 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 328/612] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:19 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:20.284208 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-689d10bc-93e3-45bd-bbe2-d96b8a1901e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:20.284208 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-689d10bc-93e3-45bd-bbe2-d96b8a1901e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:20.291898 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-689d10bc-93e3-45bd-bbe2-d96b8a1901e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:20.291898 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-689d10bc-93e3-45bd-bbe2-d96b8a1901e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:20.292089 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-689d10bc-93e3-45bd-bbe2-d96b8a1901e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:20.292495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-689d10bc-93e3-45bd-bbe2-d96b8a1901e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:20.318875 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8e0d4fe3-64bb-4590-b864-ae766a2e6a39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:20.320527 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8e0d4fe3-64bb-4590-b864-ae766a2e6a39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:20.330832 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8e0d4fe3-64bb-4590-b864-ae766a2e6a39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:20.331996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8e0d4fe3-64bb-4590-b864-ae766a2e6a39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:20.333812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8e0d4fe3-64bb-4590-b864-ae766a2e6a39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:20.334718 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8e0d4fe3-64bb-4590-b864-ae766a2e6a39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:20.423631 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-689d10bc-93e3-45bd-bbe2-d96b8a1901e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28189 microversion: 2.20 time: 0.144455 Aug 30 07:51:20.424590 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 285/613] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:20 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28189 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:20.505060 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-52d36760-2b2e-409c-92f8-b7efdca5d1ac tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:20.511652 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-52d36760-2b2e-409c-92f8-b7efdca5d1ac tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:20.519367 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-52d36760-2b2e-409c-92f8-b7efdca5d1ac tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:20.522095 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-52d36760-2b2e-409c-92f8-b7efdca5d1ac tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:20.523719 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-52d36760-2b2e-409c-92f8-b7efdca5d1ac tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:20.525155 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-52d36760-2b2e-409c-92f8-b7efdca5d1ac tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:20.571257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8e0d4fe3-64bb-4590-b864-ae766a2e6a39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.257627 Aug 30 07:51:20.573271 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 329/614] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:20 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:20.627934 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5467a3fa-b89d-4f05-aad1-9598dbfbc805 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:20.629481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5467a3fa-b89d-4f05-aad1-9598dbfbc805 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:20.648040 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5467a3fa-b89d-4f05-aad1-9598dbfbc805 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:20.648910 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5467a3fa-b89d-4f05-aad1-9598dbfbc805 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:20.650677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5467a3fa-b89d-4f05-aad1-9598dbfbc805 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:20.651636 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5467a3fa-b89d-4f05-aad1-9598dbfbc805 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:20.670747 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-52d36760-2b2e-409c-92f8-b7efdca5d1ac tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:20.679682 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-52d36760-2b2e-409c-92f8-b7efdca5d1ac tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.182772 Aug 30 07:51:20.680033 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 286/615] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:20 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:20.785608 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3ffdc727-ae5f-48c8-9bce-b7956ad1aecb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:20.789913 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3ffdc727-ae5f-48c8-9bce-b7956ad1aecb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:20.797478 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3ffdc727-ae5f-48c8-9bce-b7956ad1aecb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:20.797992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3ffdc727-ae5f-48c8-9bce-b7956ad1aecb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:20.799064 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3ffdc727-ae5f-48c8-9bce-b7956ad1aecb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:20.799575 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3ffdc727-ae5f-48c8-9bce-b7956ad1aecb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:20.810808 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5467a3fa-b89d-4f05-aad1-9598dbfbc805 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:20.819696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5467a3fa-b89d-4f05-aad1-9598dbfbc805 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1318 microversion: 2.1 time: 0.206652 Aug 30 07:51:20.820934 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 330/616] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:20 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:20.947715 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3ffdc727-ae5f-48c8-9bce-b7956ad1aecb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:20.959085 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3ffdc727-ae5f-48c8-9bce-b7956ad1aecb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.177780 Aug 30 07:51:20.959687 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 287/617] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:20 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:21.438665 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dbac653e-791a-4c8c-a849-08daaaf1e18b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:21.439668 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dbac653e-791a-4c8c-a849-08daaaf1e18b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:21.446242 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbac653e-791a-4c8c-a849-08daaaf1e18b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:21.446734 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbac653e-791a-4c8c-a849-08daaaf1e18b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:21.447515 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbac653e-791a-4c8c-a849-08daaaf1e18b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:21.447946 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbac653e-791a-4c8c-a849-08daaaf1e18b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:21.596037 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-46f755ee-337a-44eb-9bfe-4dbd9800565d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:21.597293 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-46f755ee-337a-44eb-9bfe-4dbd9800565d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:21.609102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46f755ee-337a-44eb-9bfe-4dbd9800565d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:21.609771 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46f755ee-337a-44eb-9bfe-4dbd9800565d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:21.611284 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46f755ee-337a-44eb-9bfe-4dbd9800565d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:21.611972 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46f755ee-337a-44eb-9bfe-4dbd9800565d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:21.646771 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dbac653e-791a-4c8c-a849-08daaaf1e18b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28479 microversion: 2.20 time: 0.211216 Aug 30 07:51:21.651518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 331/618] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:21 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28479 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:21.698254 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d58a3dc2-fac0-4ca9-b4b0-381e545c6113 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:21.699199 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d58a3dc2-fac0-4ca9-b4b0-381e545c6113 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:21.706523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d58a3dc2-fac0-4ca9-b4b0-381e545c6113 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:21.707006 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d58a3dc2-fac0-4ca9-b4b0-381e545c6113 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:21.707839 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d58a3dc2-fac0-4ca9-b4b0-381e545c6113 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:21.708395 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d58a3dc2-fac0-4ca9-b4b0-381e545c6113 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:21.722359 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-46f755ee-337a-44eb-9bfe-4dbd9800565d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.137844 Aug 30 07:51:21.730472 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 288/619] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:21 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:21.838028 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ae4b9662-2bb4-4204-a25c-0d4d0ed61024 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:21.839106 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ae4b9662-2bb4-4204-a25c-0d4d0ed61024 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:21.852263 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae4b9662-2bb4-4204-a25c-0d4d0ed61024 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:21.852513 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae4b9662-2bb4-4204-a25c-0d4d0ed61024 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:21.853403 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae4b9662-2bb4-4204-a25c-0d4d0ed61024 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:21.854186 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae4b9662-2bb4-4204-a25c-0d4d0ed61024 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:21.872963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d58a3dc2-fac0-4ca9-b4b0-381e545c6113 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:21.884549 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d58a3dc2-fac0-4ca9-b4b0-381e545c6113 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.190313 Aug 30 07:51:21.885506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 332/620] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:21 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:21.978633 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-460e03a5-c7a1-4416-bf30-ba6d3b524729 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:21.979531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-460e03a5-c7a1-4416-bf30-ba6d3b524729 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:21.988993 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-460e03a5-c7a1-4416-bf30-ba6d3b524729 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:21.989786 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-460e03a5-c7a1-4416-bf30-ba6d3b524729 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:21.990826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-460e03a5-c7a1-4416-bf30-ba6d3b524729 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:21.991443 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-460e03a5-c7a1-4416-bf30-ba6d3b524729 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:22.010326 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ae4b9662-2bb4-4204-a25c-0d4d0ed61024 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:22.018569 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ae4b9662-2bb4-4204-a25c-0d4d0ed61024 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1318 microversion: 2.1 time: 0.184622 Aug 30 07:51:22.020167 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 289/621] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:21 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:22.131750 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-460e03a5-c7a1-4416-bf30-ba6d3b524729 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:22.142570 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-460e03a5-c7a1-4416-bf30-ba6d3b524729 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.167917 Aug 30 07:51:22.143283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 333/622] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:21 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:22.657893 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-74146d2c-58d1-4a87-8a4e-dc215152e8d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:22.658901 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-74146d2c-58d1-4a87-8a4e-dc215152e8d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:22.666457 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-74146d2c-58d1-4a87-8a4e-dc215152e8d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:22.666899 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-74146d2c-58d1-4a87-8a4e-dc215152e8d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:22.667732 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-74146d2c-58d1-4a87-8a4e-dc215152e8d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:22.668464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-74146d2c-58d1-4a87-8a4e-dc215152e8d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:22.734045 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3d2b1834-65b1-4406-9ce3-3b8bafb25d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:22.734814 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3d2b1834-65b1-4406-9ce3-3b8bafb25d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:22.743541 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3d2b1834-65b1-4406-9ce3-3b8bafb25d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:22.744104 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3d2b1834-65b1-4406-9ce3-3b8bafb25d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:22.744856 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3d2b1834-65b1-4406-9ce3-3b8bafb25d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:22.745225 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3d2b1834-65b1-4406-9ce3-3b8bafb25d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:22.764830 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-74146d2c-58d1-4a87-8a4e-dc215152e8d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28479 microversion: 2.20 time: 0.110548 Aug 30 07:51:22.765928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 290/623] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:22 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28479 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:51:22.817433 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3d2b1834-65b1-4406-9ce3-3b8bafb25d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.086864 Aug 30 07:51:22.819007 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 334/624] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:22 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:22.904052 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-df461335-f153-466e-9667-314be98eb99a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:22.904813 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-df461335-f153-466e-9667-314be98eb99a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:22.913220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df461335-f153-466e-9667-314be98eb99a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:22.913584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df461335-f153-466e-9667-314be98eb99a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:22.914404 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df461335-f153-466e-9667-314be98eb99a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:22.914843 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df461335-f153-466e-9667-314be98eb99a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:23.037203 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3e514ec6-b7a7-42ad-a37a-0afe223effcd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:23.038505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3e514ec6-b7a7-42ad-a37a-0afe223effcd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:23.044995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3e514ec6-b7a7-42ad-a37a-0afe223effcd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:23.045445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3e514ec6-b7a7-42ad-a37a-0afe223effcd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:23.046301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3e514ec6-b7a7-42ad-a37a-0afe223effcd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:23.046679 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3e514ec6-b7a7-42ad-a37a-0afe223effcd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:23.059862 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-df461335-f153-466e-9667-314be98eb99a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:23.070020 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-df461335-f153-466e-9667-314be98eb99a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.171350 Aug 30 07:51:23.070932 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 291/625] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:22 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:23.163152 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ae9b8795-32ce-4ab4-bdaf-98df05d5b337 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:23.164511 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ae9b8795-32ce-4ab4-bdaf-98df05d5b337 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:23.171378 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae9b8795-32ce-4ab4-bdaf-98df05d5b337 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:23.172248 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae9b8795-32ce-4ab4-bdaf-98df05d5b337 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:23.173571 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae9b8795-32ce-4ab4-bdaf-98df05d5b337 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:23.174246 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae9b8795-32ce-4ab4-bdaf-98df05d5b337 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:23.225160 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3e514ec6-b7a7-42ad-a37a-0afe223effcd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:23.233684 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3e514ec6-b7a7-42ad-a37a-0afe223effcd tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1318 microversion: 2.1 time: 0.201494 Aug 30 07:51:23.236082 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 335/626] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:23 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:23.369519 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ae9b8795-32ce-4ab4-bdaf-98df05d5b337 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:23.378960 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ae9b8795-32ce-4ab4-bdaf-98df05d5b337 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.220355 Aug 30 07:51:23.382414 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 292/627] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:23 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:23.777490 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a732cf47-8eb6-4e91-bd96-ccc5eb235785 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:23.778613 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a732cf47-8eb6-4e91-bd96-ccc5eb235785 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:23.784780 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a732cf47-8eb6-4e91-bd96-ccc5eb235785 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:23.785228 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a732cf47-8eb6-4e91-bd96-ccc5eb235785 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:23.786204 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a732cf47-8eb6-4e91-bd96-ccc5eb235785 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:23.786658 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a732cf47-8eb6-4e91-bd96-ccc5eb235785 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:23.829583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6e2c478d-407d-40ec-beff-fe86c3502933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:23.831386 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6e2c478d-407d-40ec-beff-fe86c3502933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:23.839203 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6e2c478d-407d-40ec-beff-fe86c3502933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:23.840440 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6e2c478d-407d-40ec-beff-fe86c3502933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:23.840869 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6e2c478d-407d-40ec-beff-fe86c3502933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:23.841278 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6e2c478d-407d-40ec-beff-fe86c3502933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:23.875105 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a732cf47-8eb6-4e91-bd96-ccc5eb235785 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28479 microversion: 2.20 time: 0.102179 Aug 30 07:51:23.878196 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 336/628] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:23 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28479 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:51:23.932256 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6e2c478d-407d-40ec-beff-fe86c3502933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.106916 Aug 30 07:51:23.933420 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 293/629] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:23 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:23.956363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-99801a4f-84cd-4d35-9f79-9c76c4a3be9f req-0bfc9102-13e0-43e5-a5ed-bd4a4cb78c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1701e1-f55e-495f-8464-97060e8d5448", "name": "network-vif-plugged", "status": "completed", "tag": "287d7901-2ff3-42b8-bcad-da34c85d762e"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:23.959398 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:51:23.959398 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:51:23.972167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-99801a4f-84cd-4d35-9f79-9c76c4a3be9f req-0bfc9102-13e0-43e5-a5ed-bd4a4cb78c8c service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:23.972696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-99801a4f-84cd-4d35-9f79-9c76c4a3be9f req-0bfc9102-13e0-43e5-a5ed-bd4a4cb78c8c service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:23.989383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-99801a4f-84cd-4d35-9f79-9c76c4a3be9f req-0bfc9102-13e0-43e5-a5ed-bd4a4cb78c8c service nova] Creating event network-vif-plugged:287d7901-2ff3-42b8-bcad-da34c85d762e for instance ba1701e1-f55e-495f-8464-97060e8d5448 on hv-cinder-80619 Aug 30 07:51:23.995727 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-99801a4f-84cd-4d35-9f79-9c76c4a3be9f req-0bfc9102-13e0-43e5-a5ed-bd4a4cb78c8c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045458 Aug 30 07:51:23.997135 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 337/630] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:51:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:51:24.089472 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8f6060ec-9def-44bb-88c7-a867bc4014fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:24.090238 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8f6060ec-9def-44bb-88c7-a867bc4014fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:24.097282 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f6060ec-9def-44bb-88c7-a867bc4014fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:24.097758 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f6060ec-9def-44bb-88c7-a867bc4014fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:24.099092 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f6060ec-9def-44bb-88c7-a867bc4014fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:24.099579 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f6060ec-9def-44bb-88c7-a867bc4014fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:24.253144 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-888bc6bf-20a2-4518-a489-f416987d86f7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:24.254121 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-888bc6bf-20a2-4518-a489-f416987d86f7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:24.261442 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-888bc6bf-20a2-4518-a489-f416987d86f7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:24.262109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-888bc6bf-20a2-4518-a489-f416987d86f7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:24.262680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-888bc6bf-20a2-4518-a489-f416987d86f7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:24.263282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-888bc6bf-20a2-4518-a489-f416987d86f7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:24.295489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8f6060ec-9def-44bb-88c7-a867bc4014fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:24.305330 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8f6060ec-9def-44bb-88c7-a867bc4014fb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.220783 Aug 30 07:51:24.306497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 294/631] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:24 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:24.402773 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9426341a-53f4-4d1d-a4db-3eef900b1341 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:24.403498 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9426341a-53f4-4d1d-a4db-3eef900b1341 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:24.414690 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9426341a-53f4-4d1d-a4db-3eef900b1341 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:24.415637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9426341a-53f4-4d1d-a4db-3eef900b1341 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:24.416787 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9426341a-53f4-4d1d-a4db-3eef900b1341 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:24.417317 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9426341a-53f4-4d1d-a4db-3eef900b1341 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:24.439659 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-888bc6bf-20a2-4518-a489-f416987d86f7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:24.447421 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-888bc6bf-20a2-4518-a489-f416987d86f7 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1318 microversion: 2.1 time: 0.199606 Aug 30 07:51:24.453256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 338/632] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:24 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:24.580843 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9426341a-53f4-4d1d-a4db-3eef900b1341 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:24.589686 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9426341a-53f4-4d1d-a4db-3eef900b1341 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.195201 Aug 30 07:51:24.590978 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 295/633] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:24 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:24.888512 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5d24fa13-ec3e-4f72-bef7-a94186d8340f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:24.891470 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5d24fa13-ec3e-4f72-bef7-a94186d8340f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:24.901257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d24fa13-ec3e-4f72-bef7-a94186d8340f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:24.902066 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d24fa13-ec3e-4f72-bef7-a94186d8340f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:24.903591 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d24fa13-ec3e-4f72-bef7-a94186d8340f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:24.904273 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d24fa13-ec3e-4f72-bef7-a94186d8340f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:24.944981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7fd89e47-bf36-4566-8e2b-e165bff5ed74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:24.945924 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7fd89e47-bf36-4566-8e2b-e165bff5ed74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:24.953645 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7fd89e47-bf36-4566-8e2b-e165bff5ed74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:24.954239 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7fd89e47-bf36-4566-8e2b-e165bff5ed74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:24.955152 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7fd89e47-bf36-4566-8e2b-e165bff5ed74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:24.955700 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7fd89e47-bf36-4566-8e2b-e165bff5ed74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:25.013742 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5d24fa13-ec3e-4f72-bef7-a94186d8340f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28601 microversion: 2.20 time: 0.129199 Aug 30 07:51:25.014601 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 339/634] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:24 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28601 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:25.076813 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7fd89e47-bf36-4566-8e2b-e165bff5ed74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.136230 Aug 30 07:51:25.077691 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 296/635] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:24 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:25.324009 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8346ae44-97dc-447e-a248-4f4deddb96d7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:25.325017 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8346ae44-97dc-447e-a248-4f4deddb96d7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:25.331647 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8346ae44-97dc-447e-a248-4f4deddb96d7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:25.332095 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8346ae44-97dc-447e-a248-4f4deddb96d7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:25.333038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8346ae44-97dc-447e-a248-4f4deddb96d7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:25.333479 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8346ae44-97dc-447e-a248-4f4deddb96d7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:25.464724 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2751e17b-c4d5-40f8-9dbc-783ccea8479e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:25.465426 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2751e17b-c4d5-40f8-9dbc-783ccea8479e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:25.474854 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2751e17b-c4d5-40f8-9dbc-783ccea8479e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:25.475302 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2751e17b-c4d5-40f8-9dbc-783ccea8479e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:25.476077 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2751e17b-c4d5-40f8-9dbc-783ccea8479e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:25.476518 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2751e17b-c4d5-40f8-9dbc-783ccea8479e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:25.476641 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8346ae44-97dc-447e-a248-4f4deddb96d7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:25.488342 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8346ae44-97dc-447e-a248-4f4deddb96d7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.167826 Aug 30 07:51:25.490243 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 340/636] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:25 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:25.607603 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-31901d7c-ba3d-43c4-9e42-a5f7da4d6c94 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:25.608257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-31901d7c-ba3d-43c4-9e42-a5f7da4d6c94 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:25.615366 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31901d7c-ba3d-43c4-9e42-a5f7da4d6c94 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:25.615894 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31901d7c-ba3d-43c4-9e42-a5f7da4d6c94 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:25.617045 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31901d7c-ba3d-43c4-9e42-a5f7da4d6c94 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:25.617549 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-31901d7c-ba3d-43c4-9e42-a5f7da4d6c94 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:25.624114 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2751e17b-c4d5-40f8-9dbc-783ccea8479e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:25.633087 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2751e17b-c4d5-40f8-9dbc-783ccea8479e tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1318 microversion: 2.1 time: 0.172372 Aug 30 07:51:25.633795 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 297/637] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:25 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:25.753329 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-31901d7c-ba3d-43c4-9e42-a5f7da4d6c94 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:25.763595 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-31901d7c-ba3d-43c4-9e42-a5f7da4d6c94 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.159579 Aug 30 07:51:25.769905 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 341/638] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:25 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:26.025985 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e3d9c1fa-9821-4b53-80c6-3f939cc79abf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:26.027114 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e3d9c1fa-9821-4b53-80c6-3f939cc79abf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:26.033417 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3d9c1fa-9821-4b53-80c6-3f939cc79abf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:26.033872 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3d9c1fa-9821-4b53-80c6-3f939cc79abf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:26.035110 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3d9c1fa-9821-4b53-80c6-3f939cc79abf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:26.036012 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3d9c1fa-9821-4b53-80c6-3f939cc79abf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:26.080060 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-f2d61ee9-62b8-462d-994a-174720ed31da req-c7a9ce35-2d57-4799-9844-480bb81cc57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178ce678-fdfa-4447-8572-f084fb7b273b", "name": "network-vif-plugged", "status": "completed", "tag": "13b629f3-ca48-4386-acd8-de3370618d1c"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:26.081645 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:51:26.081645 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:51:26.092370 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-f2d61ee9-62b8-462d-994a-174720ed31da req-c7a9ce35-2d57-4799-9844-480bb81cc57c service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:26.092680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-f2d61ee9-62b8-462d-994a-174720ed31da req-c7a9ce35-2d57-4799-9844-480bb81cc57c service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:26.105173 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-f2d61ee9-62b8-462d-994a-174720ed31da req-c7a9ce35-2d57-4799-9844-480bb81cc57c service nova] Creating event network-vif-plugged:13b629f3-ca48-4386-acd8-de3370618d1c for instance 178ce678-fdfa-4447-8572-f084fb7b273b on hv-cinder-80619 Aug 30 07:51:26.110536 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-f2d61ee9-62b8-462d-994a-174720ed31da req-c7a9ce35-2d57-4799-9844-480bb81cc57c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034478 Aug 30 07:51:26.111452 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 342/639] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:51:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:26.117450 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-73f19e0f-2d62-482a-acac-4953feb6a234 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:26.118548 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-73f19e0f-2d62-482a-acac-4953feb6a234 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:26.125275 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-73f19e0f-2d62-482a-acac-4953feb6a234 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:26.125683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-73f19e0f-2d62-482a-acac-4953feb6a234 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:26.126400 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-73f19e0f-2d62-482a-acac-4953feb6a234 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:26.126830 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-73f19e0f-2d62-482a-acac-4953feb6a234 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:26.266486 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e3d9c1fa-9821-4b53-80c6-3f939cc79abf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.244088 Aug 30 07:51:26.268127 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 298/640] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:26 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:26.308133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-73f19e0f-2d62-482a-acac-4953feb6a234 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.192035 Aug 30 07:51:26.309074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 343/641] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:26 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:26.507662 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a7778f32-4cf2-432d-ae4f-afd07474d5af tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:26.508423 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a7778f32-4cf2-432d-ae4f-afd07474d5af tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:26.515876 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a7778f32-4cf2-432d-ae4f-afd07474d5af tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:26.516341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a7778f32-4cf2-432d-ae4f-afd07474d5af tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:26.517119 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a7778f32-4cf2-432d-ae4f-afd07474d5af tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:26.517550 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a7778f32-4cf2-432d-ae4f-afd07474d5af tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:26.651047 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-75971821-8215-4c4c-9f45-3e96dfbf73cc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:26.651753 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-75971821-8215-4c4c-9f45-3e96dfbf73cc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:26.658109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-75971821-8215-4c4c-9f45-3e96dfbf73cc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:26.658583 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-75971821-8215-4c4c-9f45-3e96dfbf73cc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:26.659365 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-75971821-8215-4c4c-9f45-3e96dfbf73cc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:26.660588 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-75971821-8215-4c4c-9f45-3e96dfbf73cc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:26.671410 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a7778f32-4cf2-432d-ae4f-afd07474d5af tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:26.680364 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a7778f32-4cf2-432d-ae4f-afd07474d5af tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.177308 Aug 30 07:51:26.681377 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 299/642] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:26 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:26.780728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-65422ea0-1289-4f89-92bd-098e063f365a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:26.781357 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-65422ea0-1289-4f89-92bd-098e063f365a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:26.788052 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65422ea0-1289-4f89-92bd-098e063f365a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:26.788510 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65422ea0-1289-4f89-92bd-098e063f365a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:26.789288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65422ea0-1289-4f89-92bd-098e063f365a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:26.789726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65422ea0-1289-4f89-92bd-098e063f365a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:26.805259 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-75971821-8215-4c4c-9f45-3e96dfbf73cc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:26.813426 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-75971821-8215-4c4c-9f45-3e96dfbf73cc tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1318 microversion: 2.1 time: 0.166282 Aug 30 07:51:26.823947 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 344/643] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:26 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:26.921882 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-65422ea0-1289-4f89-92bd-098e063f365a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:26.930116 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-65422ea0-1289-4f89-92bd-098e063f365a tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1315 microversion: 2.1 time: 0.153328 Aug 30 07:51:26.930726 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 300/644] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:26 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:27.279672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5787c130-9bc5-4786-b0e4-0fcc59fea509 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:27.280612 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5787c130-9bc5-4786-b0e4-0fcc59fea509 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:27.287478 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5787c130-9bc5-4786-b0e4-0fcc59fea509 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:27.288003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5787c130-9bc5-4786-b0e4-0fcc59fea509 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:27.288865 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5787c130-9bc5-4786-b0e4-0fcc59fea509 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:27.289458 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5787c130-9bc5-4786-b0e4-0fcc59fea509 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:27.322909 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bfac090b-4e5f-4af5-ba94-a2c021e0a196 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:27.323896 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bfac090b-4e5f-4af5-ba94-a2c021e0a196 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:27.335080 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bfac090b-4e5f-4af5-ba94-a2c021e0a196 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:27.335535 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bfac090b-4e5f-4af5-ba94-a2c021e0a196 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:27.336380 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bfac090b-4e5f-4af5-ba94-a2c021e0a196 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:27.336935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bfac090b-4e5f-4af5-ba94-a2c021e0a196 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:27.440483 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bfac090b-4e5f-4af5-ba94-a2c021e0a196 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.121604 Aug 30 07:51:27.441234 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 301/645] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:27 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:27.453243 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5787c130-9bc5-4786-b0e4-0fcc59fea509 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.176725 Aug 30 07:51:27.453717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 345/646] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:27 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:27.698440 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-356f134b-64b9-4bde-800b-042c00b5d4e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:27.699138 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-356f134b-64b9-4bde-800b-042c00b5d4e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:27.706226 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-356f134b-64b9-4bde-800b-042c00b5d4e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:27.706671 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-356f134b-64b9-4bde-800b-042c00b5d4e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:27.707699 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-356f134b-64b9-4bde-800b-042c00b5d4e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:27.708149 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-356f134b-64b9-4bde-800b-042c00b5d4e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:27.839143 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-03260d9d-5134-4caf-a4d1-b62e38388837 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:27.840123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-03260d9d-5134-4caf-a4d1-b62e38388837 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:27.850566 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-03260d9d-5134-4caf-a4d1-b62e38388837 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:27.851033 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-03260d9d-5134-4caf-a4d1-b62e38388837 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:27.852306 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-03260d9d-5134-4caf-a4d1-b62e38388837 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:27.852853 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-03260d9d-5134-4caf-a4d1-b62e38388837 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:27.866011 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-356f134b-64b9-4bde-800b-042c00b5d4e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:27.882599 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-356f134b-64b9-4bde-800b-042c00b5d4e9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.188457 Aug 30 07:51:27.894303 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 302/647] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:27 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:27.957293 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9b552bf4-3131-47f6-97ed-de82a8e0d0a8 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:27.959220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9b552bf4-3131-47f6-97ed-de82a8e0d0a8 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:27.972984 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b552bf4-3131-47f6-97ed-de82a8e0d0a8 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:27.973509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b552bf4-3131-47f6-97ed-de82a8e0d0a8 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:27.974585 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b552bf4-3131-47f6-97ed-de82a8e0d0a8 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:27.975099 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b552bf4-3131-47f6-97ed-de82a8e0d0a8 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:28.021993 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-03260d9d-5134-4caf-a4d1-b62e38388837 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:28.036766 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-03260d9d-5134-4caf-a4d1-b62e38388837 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1318 microversion: 2.1 time: 0.208013 Aug 30 07:51:28.045960 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 346/648] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:27 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:28.114402 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9b552bf4-3131-47f6-97ed-de82a8e0d0a8 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:28.122567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9b552bf4-3131-47f6-97ed-de82a8e0d0a8 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1465 microversion: 2.1 time: 0.170079 Aug 30 07:51:28.123022 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 303/649] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:27 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1465 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:28.166252 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-75ec2c81-047d-49e5-a285-e3fe17fc64ab tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:28.166946 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-75ec2c81-047d-49e5-a285-e3fe17fc64ab tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:28.173316 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-75ec2c81-047d-49e5-a285-e3fe17fc64ab tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:28.173772 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-75ec2c81-047d-49e5-a285-e3fe17fc64ab tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:28.174578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-75ec2c81-047d-49e5-a285-e3fe17fc64ab tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:28.175012 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-75ec2c81-047d-49e5-a285-e3fe17fc64ab tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:28.203718 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-75ec2c81-047d-49e5-a285-e3fe17fc64ab tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:51:28.311378 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-75ec2c81-047d-49e5-a285-e3fe17fc64ab tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 204 len: 0 microversion: 2.1 time: 0.147823 Aug 30 07:51:28.312637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 347/650] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:51:28 2021] DELETE /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:51:28.321873 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0d63b359-d4f5-43ff-bfe1-6faa2ebe3ddb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:28.322676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0d63b359-d4f5-43ff-bfe1-6faa2ebe3ddb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:28.329416 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0d63b359-d4f5-43ff-bfe1-6faa2ebe3ddb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:28.330093 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0d63b359-d4f5-43ff-bfe1-6faa2ebe3ddb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:28.330674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0d63b359-d4f5-43ff-bfe1-6faa2ebe3ddb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:28.331120 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0d63b359-d4f5-43ff-bfe1-6faa2ebe3ddb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:28.455969 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-910f8591-f296-411c-a39f-ca786417dd0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:28.458401 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-910f8591-f296-411c-a39f-ca786417dd0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:28.467648 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-910f8591-f296-411c-a39f-ca786417dd0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:28.468247 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-910f8591-f296-411c-a39f-ca786417dd0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:28.469309 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-910f8591-f296-411c-a39f-ca786417dd0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:28.469887 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-910f8591-f296-411c-a39f-ca786417dd0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:28.478857 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0d63b359-d4f5-43ff-bfe1-6faa2ebe3ddb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:28.492000 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0d63b359-d4f5-43ff-bfe1-6faa2ebe3ddb tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1471 microversion: 2.1 time: 0.174232 Aug 30 07:51:28.506698 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 304/651] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:28 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:28.515800 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5b6adb8d-29fc-4bc6-84a4-20dac3827500 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:28.517503 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5b6adb8d-29fc-4bc6-84a4-20dac3827500 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:28.525008 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b6adb8d-29fc-4bc6-84a4-20dac3827500 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:28.525454 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b6adb8d-29fc-4bc6-84a4-20dac3827500 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:28.526269 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b6adb8d-29fc-4bc6-84a4-20dac3827500 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:28.526706 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b6adb8d-29fc-4bc6-84a4-20dac3827500 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:28.570553 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-910f8591-f296-411c-a39f-ca786417dd0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.120260 Aug 30 07:51:28.571454 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 348/652] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:28 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:28.713460 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5b6adb8d-29fc-4bc6-84a4-20dac3827500 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.204218 Aug 30 07:51:28.714500 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 305/653] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:28 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:28.909600 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-68bc7b73-9316-4764-8eac-bc510f0d9664 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:28.911283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-68bc7b73-9316-4764-8eac-bc510f0d9664 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:28.919801 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-68bc7b73-9316-4764-8eac-bc510f0d9664 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:28.921103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-68bc7b73-9316-4764-8eac-bc510f0d9664 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:28.921467 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-68bc7b73-9316-4764-8eac-bc510f0d9664 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:28.922178 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-68bc7b73-9316-4764-8eac-bc510f0d9664 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:29.054258 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-561c0ca7-7250-43c8-aeaf-3bf95cded263 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:29.054972 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-561c0ca7-7250-43c8-aeaf-3bf95cded263 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:29.062785 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-561c0ca7-7250-43c8-aeaf-3bf95cded263 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:29.063246 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-561c0ca7-7250-43c8-aeaf-3bf95cded263 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:29.064083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-561c0ca7-7250-43c8-aeaf-3bf95cded263 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:29.064452 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-561c0ca7-7250-43c8-aeaf-3bf95cded263 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:29.080949 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-68bc7b73-9316-4764-8eac-bc510f0d9664 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:29.092178 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-68bc7b73-9316-4764-8eac-bc510f0d9664 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.191985 Aug 30 07:51:29.093349 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 349/654] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:28 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:29.250113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-561c0ca7-7250-43c8-aeaf-3bf95cded263 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:29.259554 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-561c0ca7-7250-43c8-aeaf-3bf95cded263 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1508 microversion: 2.1 time: 0.210150 Aug 30 07:51:29.260252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 306/655] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:29 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1508 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:29.520275 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-74858efa-5bd9-4c42-af4a-c7ed3a0b9443 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:29.521978 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-74858efa-5bd9-4c42-af4a-c7ed3a0b9443 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:29.536735 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-74858efa-5bd9-4c42-af4a-c7ed3a0b9443 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:29.537255 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-74858efa-5bd9-4c42-af4a-c7ed3a0b9443 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:29.539790 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-74858efa-5bd9-4c42-af4a-c7ed3a0b9443 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:29.540780 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-74858efa-5bd9-4c42-af4a-c7ed3a0b9443 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:29.598416 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-032f1636-e8e7-4232-a87c-13116a02020b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:29.610247 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-032f1636-e8e7-4232-a87c-13116a02020b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:29.623690 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-032f1636-e8e7-4232-a87c-13116a02020b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:29.629762 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-032f1636-e8e7-4232-a87c-13116a02020b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:29.630944 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-032f1636-e8e7-4232-a87c-13116a02020b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:29.631541 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-032f1636-e8e7-4232-a87c-13116a02020b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:29.746450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-032f1636-e8e7-4232-a87c-13116a02020b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.163461 Aug 30 07:51:29.748132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 307/656] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:29 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:29.759603 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e29d26d4-8739-4ebf-8633-a9d1be99e6a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:29.761863 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e29d26d4-8739-4ebf-8633-a9d1be99e6a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:29.764428 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-74858efa-5bd9-4c42-af4a-c7ed3a0b9443 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:29.773168 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e29d26d4-8739-4ebf-8633-a9d1be99e6a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:29.773432 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-74858efa-5bd9-4c42-af4a-c7ed3a0b9443 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1471 microversion: 2.1 time: 0.258070 Aug 30 07:51:29.773953 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 350/657] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:29 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:29.774634 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e29d26d4-8739-4ebf-8633-a9d1be99e6a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:29.775754 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e29d26d4-8739-4ebf-8633-a9d1be99e6a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:29.776380 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e29d26d4-8739-4ebf-8633-a9d1be99e6a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:29.874678 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e29d26d4-8739-4ebf-8633-a9d1be99e6a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.123911 Aug 30 07:51:29.875333 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 308/658] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:29 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:30.114119 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-66523687-5691-4960-937d-ed668370a5fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:30.115140 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-66523687-5691-4960-937d-ed668370a5fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:30.127230 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-66523687-5691-4960-937d-ed668370a5fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:30.128069 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-66523687-5691-4960-937d-ed668370a5fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:30.129880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-66523687-5691-4960-937d-ed668370a5fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:30.130500 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-66523687-5691-4960-937d-ed668370a5fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:30.303221 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-66523687-5691-4960-937d-ed668370a5fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:30.311605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-66523687-5691-4960-937d-ed668370a5fc tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.203884 Aug 30 07:51:30.312182 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 351/659] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:30 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:30.760845 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7f25cb86-0b17-4a6f-aac2-3f84f49c2730 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:30.761948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7f25cb86-0b17-4a6f-aac2-3f84f49c2730 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:30.769811 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f25cb86-0b17-4a6f-aac2-3f84f49c2730 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:30.770418 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f25cb86-0b17-4a6f-aac2-3f84f49c2730 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:30.771210 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f25cb86-0b17-4a6f-aac2-3f84f49c2730 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:30.771642 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f25cb86-0b17-4a6f-aac2-3f84f49c2730 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:30.792208 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f190a42d-a516-45c3-b72b-f54df2fcebcf tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:30.793107 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f190a42d-a516-45c3-b72b-f54df2fcebcf tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:30.802727 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f190a42d-a516-45c3-b72b-f54df2fcebcf tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:30.803194 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f190a42d-a516-45c3-b72b-f54df2fcebcf tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:30.803971 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f190a42d-a516-45c3-b72b-f54df2fcebcf tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:30.804396 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f190a42d-a516-45c3-b72b-f54df2fcebcf tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:30.905346 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7f25cb86-0b17-4a6f-aac2-3f84f49c2730 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.148622 Aug 30 07:51:30.906394 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 309/660] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:30 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:30.912732 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b99ef59e-01c7-4f2d-aa90-0c2a0e0e35b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:30.914067 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b99ef59e-01c7-4f2d-aa90-0c2a0e0e35b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:30.921649 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b99ef59e-01c7-4f2d-aa90-0c2a0e0e35b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:30.922090 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b99ef59e-01c7-4f2d-aa90-0c2a0e0e35b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:30.923063 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b99ef59e-01c7-4f2d-aa90-0c2a0e0e35b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:30.923498 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b99ef59e-01c7-4f2d-aa90-0c2a0e0e35b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:30.958601 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f190a42d-a516-45c3-b72b-f54df2fcebcf tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:30.967130 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f190a42d-a516-45c3-b72b-f54df2fcebcf tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1471 microversion: 2.1 time: 0.179097 Aug 30 07:51:30.968134 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 352/661] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:30 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:31.165130 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b99ef59e-01c7-4f2d-aa90-0c2a0e0e35b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.257063 Aug 30 07:51:31.165785 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 310/662] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:30 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:31.339083 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6a03a126-a2be-41a8-8620-cbd0b5018101 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:31.340351 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6a03a126-a2be-41a8-8620-cbd0b5018101 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:31.351234 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a03a126-a2be-41a8-8620-cbd0b5018101 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:31.351234 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a03a126-a2be-41a8-8620-cbd0b5018101 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:31.351234 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a03a126-a2be-41a8-8620-cbd0b5018101 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:31.351234 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a03a126-a2be-41a8-8620-cbd0b5018101 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:31.500775 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6a03a126-a2be-41a8-8620-cbd0b5018101 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:31.511528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6a03a126-a2be-41a8-8620-cbd0b5018101 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.178159 Aug 30 07:51:31.512468 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 353/663] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:31 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:31.809342 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-1510fa4b-1d2b-49dd-a507-861f9d4093ea req-067b999d-8390-41a2-8f86-01011a458ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1701e1-f55e-495f-8464-97060e8d5448", "name": "network-vif-deleted", "tag": "287d7901-2ff3-42b8-bcad-da34c85d762e"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:31.811118 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:51:31.811118 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:51:31.823780 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-1510fa4b-1d2b-49dd-a507-861f9d4093ea req-067b999d-8390-41a2-8f86-01011a458ecf service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:31.824248 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-1510fa4b-1d2b-49dd-a507-861f9d4093ea req-067b999d-8390-41a2-8f86-01011a458ecf service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:31.846737 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-1510fa4b-1d2b-49dd-a507-861f9d4093ea req-067b999d-8390-41a2-8f86-01011a458ecf service nova] Creating event network-vif-deleted:287d7901-2ff3-42b8-bcad-da34c85d762e for instance ba1701e1-f55e-495f-8464-97060e8d5448 on hv-cinder-80619 Aug 30 07:51:31.852611 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-1510fa4b-1d2b-49dd-a507-861f9d4093ea req-067b999d-8390-41a2-8f86-01011a458ecf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047375 Aug 30 07:51:31.857207 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 311/664] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:51:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:31.895357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-673e61f7-2f3d-4134-864e-2df76216b900 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "062963af-d67b-4c5a-8d31-f791778ae453"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:31.897793 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-673e61f7-2f3d-4134-864e-2df76216b900 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:31.907458 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-673e61f7-2f3d-4134-864e-2df76216b900 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:31.908615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-673e61f7-2f3d-4134-864e-2df76216b900 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:31.909704 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-673e61f7-2f3d-4134-864e-2df76216b900 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:31.912206 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-673e61f7-2f3d-4134-864e-2df76216b900 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:31.921119 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bf055d33-e982-46c7-a827-1e8e6ff34b13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:31.922756 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bf055d33-e982-46c7-a827-1e8e6ff34b13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:31.936020 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf055d33-e982-46c7-a827-1e8e6ff34b13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:31.936604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf055d33-e982-46c7-a827-1e8e6ff34b13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:31.942451 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf055d33-e982-46c7-a827-1e8e6ff34b13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:31.943928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf055d33-e982-46c7-a827-1e8e6ff34b13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:32.067009 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bf055d33-e982-46c7-a827-1e8e6ff34b13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.151070 Aug 30 07:51:32.067962 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 312/665] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:31 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:32.073826 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4e98993f-bd03-47ab-8a42-f351bad3cb68 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:32.074578 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4e98993f-bd03-47ab-8a42-f351bad3cb68 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:32.081967 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4e98993f-bd03-47ab-8a42-f351bad3cb68 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:32.082354 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4e98993f-bd03-47ab-8a42-f351bad3cb68 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:32.083170 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4e98993f-bd03-47ab-8a42-f351bad3cb68 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:32.083897 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4e98993f-bd03-47ab-8a42-f351bad3cb68 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:32.121585 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4e98993f-bd03-47ab-8a42-f351bad3cb68 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:32.122038 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4e98993f-bd03-47ab-8a42-f351bad3cb68 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:32.122721 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-4e98993f-bd03-47ab-8a42-f351bad3cb68 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lazy-loading 'fault' on Instance uuid ba1701e1-f55e-495f-8464-97060e8d5448 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:51:32.175172 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4e98993f-bd03-47ab-8a42-f351bad3cb68 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba885bf8790e4f4d9dc835b2022d4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481725f1bdc64b708f229129a79b8326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:32.184453 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4e98993f-bd03-47ab-8a42-f351bad3cb68 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 200 len: 1305 microversion: 2.1 time: 0.115031 Aug 30 07:51:32.185506 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 313/666] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:32 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:32.189509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4f25e02c-eb12-42c3-a2fe-1bddcafd9a89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:32.190473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4f25e02c-eb12-42c3-a2fe-1bddcafd9a89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:32.198234 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f25e02c-eb12-42c3-a2fe-1bddcafd9a89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:32.198665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f25e02c-eb12-42c3-a2fe-1bddcafd9a89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:32.199462 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f25e02c-eb12-42c3-a2fe-1bddcafd9a89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:32.199897 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f25e02c-eb12-42c3-a2fe-1bddcafd9a89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:32.282933 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4f25e02c-eb12-42c3-a2fe-1bddcafd9a89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.096276 Aug 30 07:51:32.284195 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 314/667] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:32 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:32.367918 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-673e61f7-2f3d-4134-864e-2df76216b900 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "POST /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.495680 Aug 30 07:51:32.368587 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 354/668] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:51:31 2021] POST /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:32.532198 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-438160a6-138f-45a7-a98d-d2053e2cff66 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:32.532922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-438160a6-138f-45a7-a98d-d2053e2cff66 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:32.541651 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-438160a6-138f-45a7-a98d-d2053e2cff66 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:32.542284 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-438160a6-138f-45a7-a98d-d2053e2cff66 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:32.543321 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-438160a6-138f-45a7-a98d-d2053e2cff66 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:32.543973 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-438160a6-138f-45a7-a98d-d2053e2cff66 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:32.702923 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-438160a6-138f-45a7-a98d-d2053e2cff66 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:32.712365 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-438160a6-138f-45a7-a98d-d2053e2cff66 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.184994 Aug 30 07:51:32.722123 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 315/669] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:32 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:33.079295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dfa951eb-8878-4fef-a323-d3c1db1e3466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:33.080407 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dfa951eb-8878-4fef-a323-d3c1db1e3466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:33.087659 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dfa951eb-8878-4fef-a323-d3c1db1e3466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:33.088117 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dfa951eb-8878-4fef-a323-d3c1db1e3466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:33.088902 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dfa951eb-8878-4fef-a323-d3c1db1e3466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:33.089335 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dfa951eb-8878-4fef-a323-d3c1db1e3466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:33.209266 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-86ccdd2e-47bc-4440-9d26-091ecbc50d40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:33.209890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-86ccdd2e-47bc-4440-9d26-091ecbc50d40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] [instance: ba1701e1-f55e-495f-8464-97060e8d5448] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:33.215251 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dfa951eb-8878-4fef-a323-d3c1db1e3466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.139720 Aug 30 07:51:33.217070 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 355/670] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:33 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:33.217598 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-86ccdd2e-47bc-4440-9d26-091ecbc50d40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:33.218745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-86ccdd2e-47bc-4440-9d26-091ecbc50d40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:33.220452 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-86ccdd2e-47bc-4440-9d26-091ecbc50d40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:33.221589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-86ccdd2e-47bc-4440-9d26-091ecbc50d40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:33.251256 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-86ccdd2e-47bc-4440-9d26-091ecbc50d40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] HTTP exception thrown: Instance ba1701e1-f55e-495f-8464-97060e8d5448 could not be found. Aug 30 07:51:33.252329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-86ccdd2e-47bc-4440-9d26-091ecbc50d40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] Returning 404 to user: Instance ba1701e1-f55e-495f-8464-97060e8d5448 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:51:33.253718 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-86ccdd2e-47bc-4440-9d26-091ecbc50d40 tempest-VolumesNegativeTest-294555213 tempest-VolumesNegativeTest-294555213-project] 10.222.0.73 "GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448" status: 404 len: 111 microversion: 2.1 time: 0.048349 Aug 30 07:51:33.255265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 316/671] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:33 2021] GET /compute/v2.1/servers/ba1701e1-f55e-495f-8464-97060e8d5448 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:51:33.304568 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-653d8e3a-3b97-4d00-80e0-4cb88d9087b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:33.306721 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-653d8e3a-3b97-4d00-80e0-4cb88d9087b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:33.319655 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-653d8e3a-3b97-4d00-80e0-4cb88d9087b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:33.320581 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-653d8e3a-3b97-4d00-80e0-4cb88d9087b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:33.322175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-653d8e3a-3b97-4d00-80e0-4cb88d9087b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:33.322954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-653d8e3a-3b97-4d00-80e0-4cb88d9087b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:33.448830 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-653d8e3a-3b97-4d00-80e0-4cb88d9087b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.153489 Aug 30 07:51:33.449645 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 356/672] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:33 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:33.729141 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bbd9e7c6-6e6d-48d6-9bce-918e1960715a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:33.729643 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bbd9e7c6-6e6d-48d6-9bce-918e1960715a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:33.736445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bbd9e7c6-6e6d-48d6-9bce-918e1960715a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:33.736896 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bbd9e7c6-6e6d-48d6-9bce-918e1960715a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:33.737737 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bbd9e7c6-6e6d-48d6-9bce-918e1960715a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:33.738400 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bbd9e7c6-6e6d-48d6-9bce-918e1960715a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:33.897245 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-bbd9e7c6-6e6d-48d6-9bce-918e1960715a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:33.906502 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bbd9e7c6-6e6d-48d6-9bce-918e1960715a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.181306 Aug 30 07:51:33.907146 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 317/673] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:33 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:34.231560 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d650ba8a-e909-495a-9c26-ac48a237fdfc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:34.233394 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d650ba8a-e909-495a-9c26-ac48a237fdfc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:34.243900 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d650ba8a-e909-495a-9c26-ac48a237fdfc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:34.244571 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d650ba8a-e909-495a-9c26-ac48a237fdfc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:34.246000 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d650ba8a-e909-495a-9c26-ac48a237fdfc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:34.246457 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d650ba8a-e909-495a-9c26-ac48a237fdfc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:34.336303 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d650ba8a-e909-495a-9c26-ac48a237fdfc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.109196 Aug 30 07:51:34.337003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 357/674] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:34 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:34.462385 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1a79547c-94af-4ef5-a0fb-0ac3f514bf9d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:34.463445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1a79547c-94af-4ef5-a0fb-0ac3f514bf9d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:34.469378 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1a79547c-94af-4ef5-a0fb-0ac3f514bf9d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:34.469824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1a79547c-94af-4ef5-a0fb-0ac3f514bf9d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:34.470630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1a79547c-94af-4ef5-a0fb-0ac3f514bf9d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:34.471060 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1a79547c-94af-4ef5-a0fb-0ac3f514bf9d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:34.557348 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1a79547c-94af-4ef5-a0fb-0ac3f514bf9d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.098637 Aug 30 07:51:34.559366 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 318/675] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:34 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:34.927148 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3ff49dab-9d66-4f43-b743-ceda06fae12c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:34.928314 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3ff49dab-9d66-4f43-b743-ceda06fae12c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:34.937357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ff49dab-9d66-4f43-b743-ceda06fae12c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:34.938013 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ff49dab-9d66-4f43-b743-ceda06fae12c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:34.939145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ff49dab-9d66-4f43-b743-ceda06fae12c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:34.939857 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ff49dab-9d66-4f43-b743-ceda06fae12c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:35.087354 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3ff49dab-9d66-4f43-b743-ceda06fae12c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:35.095646 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3ff49dab-9d66-4f43-b743-ceda06fae12c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.174305 Aug 30 07:51:35.096248 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 358/676] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:34 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:35.353600 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-83ec3611-832a-4cbd-87a3-7990632e5ec7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:35.355685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-83ec3611-832a-4cbd-87a3-7990632e5ec7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:35.371573 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-83ec3611-832a-4cbd-87a3-7990632e5ec7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:35.372623 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-83ec3611-832a-4cbd-87a3-7990632e5ec7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:35.376218 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-83ec3611-832a-4cbd-87a3-7990632e5ec7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:35.377441 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-83ec3611-832a-4cbd-87a3-7990632e5ec7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:35.467224 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-83ec3611-832a-4cbd-87a3-7990632e5ec7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.120433 Aug 30 07:51:35.467965 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 319/677] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:35 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:35.570542 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6d2f0a52-2921-4da9-ac15-8af0c607c298 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:35.571582 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6d2f0a52-2921-4da9-ac15-8af0c607c298 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:35.577600 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d2f0a52-2921-4da9-ac15-8af0c607c298 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:35.578087 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d2f0a52-2921-4da9-ac15-8af0c607c298 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:35.578934 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d2f0a52-2921-4da9-ac15-8af0c607c298 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:35.579592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d2f0a52-2921-4da9-ac15-8af0c607c298 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:35.688207 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6d2f0a52-2921-4da9-ac15-8af0c607c298 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.117385 Aug 30 07:51:35.688972 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 359/678] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:35 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:36.113549 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1bcea320-1ba1-4602-ba14-56b6d760e103 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:36.114456 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1bcea320-1ba1-4602-ba14-56b6d760e103 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:36.121619 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bcea320-1ba1-4602-ba14-56b6d760e103 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:36.122160 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bcea320-1ba1-4602-ba14-56b6d760e103 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:36.123452 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bcea320-1ba1-4602-ba14-56b6d760e103 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:36.124129 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bcea320-1ba1-4602-ba14-56b6d760e103 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:36.285863 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1bcea320-1ba1-4602-ba14-56b6d760e103 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:36.295018 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1bcea320-1ba1-4602-ba14-56b6d760e103 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.186011 Aug 30 07:51:36.298188 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 320/679] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:36 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:36.480296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-02795004-c4ed-434b-9e37-2351622380c3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:36.481231 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-02795004-c4ed-434b-9e37-2351622380c3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:36.487812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-02795004-c4ed-434b-9e37-2351622380c3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:36.488792 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-02795004-c4ed-434b-9e37-2351622380c3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:36.489577 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-02795004-c4ed-434b-9e37-2351622380c3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:36.490007 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-02795004-c4ed-434b-9e37-2351622380c3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:36.567225 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-02795004-c4ed-434b-9e37-2351622380c3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.090913 Aug 30 07:51:36.568301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 360/680] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:36 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:36.701720 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-82ef603b-3211-459c-a245-e328c2554640 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:36.702886 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-82ef603b-3211-459c-a245-e328c2554640 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:36.709042 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-82ef603b-3211-459c-a245-e328c2554640 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:36.709486 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-82ef603b-3211-459c-a245-e328c2554640 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:36.710356 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-82ef603b-3211-459c-a245-e328c2554640 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:36.710912 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-82ef603b-3211-459c-a245-e328c2554640 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:36.809861 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-82ef603b-3211-459c-a245-e328c2554640 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.111773 Aug 30 07:51:36.810482 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 321/681] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:36 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:37.313473 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c8239152-89f4-45cf-b1ff-a5f376163b1d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:37.314355 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c8239152-89f4-45cf-b1ff-a5f376163b1d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:37.321437 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c8239152-89f4-45cf-b1ff-a5f376163b1d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:37.321883 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c8239152-89f4-45cf-b1ff-a5f376163b1d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:37.322739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c8239152-89f4-45cf-b1ff-a5f376163b1d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:37.323364 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c8239152-89f4-45cf-b1ff-a5f376163b1d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:37.469151 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c8239152-89f4-45cf-b1ff-a5f376163b1d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:37.478838 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c8239152-89f4-45cf-b1ff-a5f376163b1d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.169287 Aug 30 07:51:37.479629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 361/682] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:37 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:37.587023 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1f3a7d12-885a-4448-b3c1-7b9f3bacb601 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:37.589021 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1f3a7d12-885a-4448-b3c1-7b9f3bacb601 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:37.605182 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1f3a7d12-885a-4448-b3c1-7b9f3bacb601 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:37.605965 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1f3a7d12-885a-4448-b3c1-7b9f3bacb601 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:37.607481 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1f3a7d12-885a-4448-b3c1-7b9f3bacb601 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:37.608807 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1f3a7d12-885a-4448-b3c1-7b9f3bacb601 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:37.707260 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1f3a7d12-885a-4448-b3c1-7b9f3bacb601 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.130113 Aug 30 07:51:37.713727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 322/683] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:37 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:37.824126 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4b319043-f921-4f77-b664-cbbd756109d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:37.825512 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4b319043-f921-4f77-b664-cbbd756109d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:37.832848 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b319043-f921-4f77-b664-cbbd756109d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:37.833420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b319043-f921-4f77-b664-cbbd756109d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:37.834463 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b319043-f921-4f77-b664-cbbd756109d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:37.835351 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b319043-f921-4f77-b664-cbbd756109d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:38.004722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4b319043-f921-4f77-b664-cbbd756109d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.186462 Aug 30 07:51:38.005362 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 362/684] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:37 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:51:38.500798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5ebbad23-0b1a-473b-9c26-8d7019c30698 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:38.501656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5ebbad23-0b1a-473b-9c26-8d7019c30698 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:38.508992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5ebbad23-0b1a-473b-9c26-8d7019c30698 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:38.509440 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5ebbad23-0b1a-473b-9c26-8d7019c30698 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:38.510470 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5ebbad23-0b1a-473b-9c26-8d7019c30698 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:38.510934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5ebbad23-0b1a-473b-9c26-8d7019c30698 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:38.640682 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5ebbad23-0b1a-473b-9c26-8d7019c30698 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:38.650252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5ebbad23-0b1a-473b-9c26-8d7019c30698 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.154575 Aug 30 07:51:38.651247 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 323/685] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:38 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:38.721421 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-073221cd-5525-49d5-aaa5-c4d9d2e6f643 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:38.722907 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-073221cd-5525-49d5-aaa5-c4d9d2e6f643 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:38.729961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-073221cd-5525-49d5-aaa5-c4d9d2e6f643 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:38.730442 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-073221cd-5525-49d5-aaa5-c4d9d2e6f643 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:38.731213 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-073221cd-5525-49d5-aaa5-c4d9d2e6f643 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:38.731638 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-073221cd-5525-49d5-aaa5-c4d9d2e6f643 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:38.821663 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-073221cd-5525-49d5-aaa5-c4d9d2e6f643 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.104461 Aug 30 07:51:38.822615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 363/686] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:38 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:39.015478 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1e727555-ed20-4abc-9bc5-4a298e7d38ba tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:39.016429 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1e727555-ed20-4abc-9bc5-4a298e7d38ba tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:39.023440 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1e727555-ed20-4abc-9bc5-4a298e7d38ba tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:39.023889 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1e727555-ed20-4abc-9bc5-4a298e7d38ba tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:39.024657 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1e727555-ed20-4abc-9bc5-4a298e7d38ba tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:39.025091 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1e727555-ed20-4abc-9bc5-4a298e7d38ba tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:39.110024 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1e727555-ed20-4abc-9bc5-4a298e7d38ba tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.098030 Aug 30 07:51:39.110713 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 324/687] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:39 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:39.670776 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ce395c61-0b6f-46bd-bfa4-f92d729e8741 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:39.671580 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ce395c61-0b6f-46bd-bfa4-f92d729e8741 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:39.679393 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce395c61-0b6f-46bd-bfa4-f92d729e8741 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:39.679841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce395c61-0b6f-46bd-bfa4-f92d729e8741 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:39.680615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce395c61-0b6f-46bd-bfa4-f92d729e8741 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:39.681109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce395c61-0b6f-46bd-bfa4-f92d729e8741 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:39.805754 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ce395c61-0b6f-46bd-bfa4-f92d729e8741 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:39.815708 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ce395c61-0b6f-46bd-bfa4-f92d729e8741 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.150311 Aug 30 07:51:39.816785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 364/688] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:39 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:39.834880 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-213da5eb-375c-42e9-af74-23cd25f67d06 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:39.835869 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-213da5eb-375c-42e9-af74-23cd25f67d06 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:39.842695 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-213da5eb-375c-42e9-af74-23cd25f67d06 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:39.843744 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-213da5eb-375c-42e9-af74-23cd25f67d06 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:39.844054 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-213da5eb-375c-42e9-af74-23cd25f67d06 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:39.844302 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-213da5eb-375c-42e9-af74-23cd25f67d06 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:39.926985 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-213da5eb-375c-42e9-af74-23cd25f67d06 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.095854 Aug 30 07:51:39.927582 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 325/689] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:39 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:40.123268 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4c5d93cd-b940-4fa3-ba26-e00b2fb30441 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:40.124452 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4c5d93cd-b940-4fa3-ba26-e00b2fb30441 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:40.131556 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4c5d93cd-b940-4fa3-ba26-e00b2fb30441 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:40.132657 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4c5d93cd-b940-4fa3-ba26-e00b2fb30441 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:40.134820 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4c5d93cd-b940-4fa3-ba26-e00b2fb30441 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:40.136035 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4c5d93cd-b940-4fa3-ba26-e00b2fb30441 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:40.254205 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4c5d93cd-b940-4fa3-ba26-e00b2fb30441 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.134475 Aug 30 07:51:40.258775 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 365/690] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:40 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:40.834075 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-300d689a-f318-404e-b748-77782c98b013 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:40.835086 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-300d689a-f318-404e-b748-77782c98b013 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:40.842296 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-300d689a-f318-404e-b748-77782c98b013 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:40.842894 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-300d689a-f318-404e-b748-77782c98b013 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:40.843785 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-300d689a-f318-404e-b748-77782c98b013 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:40.844307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-300d689a-f318-404e-b748-77782c98b013 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:40.957559 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-62b59573-3b8c-463b-9ad5-82a09a562f91 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:40.964184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-62b59573-3b8c-463b-9ad5-82a09a562f91 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:40.980225 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-62b59573-3b8c-463b-9ad5-82a09a562f91 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:40.980972 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-62b59573-3b8c-463b-9ad5-82a09a562f91 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:40.982305 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-62b59573-3b8c-463b-9ad5-82a09a562f91 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:40.983030 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-62b59573-3b8c-463b-9ad5-82a09a562f91 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:41.005586 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-300d689a-f318-404e-b748-77782c98b013 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:41.016646 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-300d689a-f318-404e-b748-77782c98b013 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.187314 Aug 30 07:51:41.017727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 326/691] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:40 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:41.074769 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-62b59573-3b8c-463b-9ad5-82a09a562f91 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.135056 Aug 30 07:51:41.076047 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 366/692] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:40 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:41.236992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9d2d43c3-b49e-4e86-bb1a-ec9dfe770182 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:41.237825 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9d2d43c3-b49e-4e86-bb1a-ec9dfe770182 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:41.257909 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9d2d43c3-b49e-4e86-bb1a-ec9dfe770182 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:41.258387 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9d2d43c3-b49e-4e86-bb1a-ec9dfe770182 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:41.260986 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9d2d43c3-b49e-4e86-bb1a-ec9dfe770182 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:41.261578 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9d2d43c3-b49e-4e86-bb1a-ec9dfe770182 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:41.272852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-45da1525-8441-400e-8ae2-de28a84ffb0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:41.275390 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-45da1525-8441-400e-8ae2-de28a84ffb0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:41.285445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-45da1525-8441-400e-8ae2-de28a84ffb0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:41.285895 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-45da1525-8441-400e-8ae2-de28a84ffb0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:41.286700 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-45da1525-8441-400e-8ae2-de28a84ffb0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:41.287131 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-45da1525-8441-400e-8ae2-de28a84ffb0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:41.386794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-9d2d43c3-b49e-4e86-bb1a-ec9dfe770182 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lazy-loading 'services' on Instance uuid 178ce678-fdfa-4447-8572-f084fb7b273b {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:51:41.394563 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-45da1525-8441-400e-8ae2-de28a84ffb0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.130104 Aug 30 07:51:41.399183 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 367/693] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:41 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:41.480067 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9d2d43c3-b49e-4e86-bb1a-ec9dfe770182 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "DELETE /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b/os-volume_attachments/062963af-d67b-4c5a-8d31-f791778ae453" status: 202 len: 0 microversion: 2.1 time: 0.246766 Aug 30 07:51:41.492291 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 327/694] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:51:41 2021] DELETE /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b/os-volume_attachments/062963af-d67b-4c5a-8d31-f791778ae453 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:41.500812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6ca2ebd2-9997-4cf6-b6e5-5e772c49d130 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:41.507003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6ca2ebd2-9997-4cf6-b6e5-5e772c49d130 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:41.523863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ca2ebd2-9997-4cf6-b6e5-5e772c49d130 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:41.524470 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ca2ebd2-9997-4cf6-b6e5-5e772c49d130 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:41.525385 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ca2ebd2-9997-4cf6-b6e5-5e772c49d130 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:41.525968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ca2ebd2-9997-4cf6-b6e5-5e772c49d130 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:41.567420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6ca2ebd2-9997-4cf6-b6e5-5e772c49d130 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080330 Aug 30 07:51:41.568598 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 368/695] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:41 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:42.037507 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-24d35930-c751-44f1-b955-236deceafdf8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:42.038022 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-24d35930-c751-44f1-b955-236deceafdf8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:42.044734 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-24d35930-c751-44f1-b955-236deceafdf8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:42.045243 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-24d35930-c751-44f1-b955-236deceafdf8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:42.046564 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-24d35930-c751-44f1-b955-236deceafdf8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:42.047379 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-24d35930-c751-44f1-b955-236deceafdf8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:42.086963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8b8247ce-b03c-4787-ba5a-5bc0f0c093e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:42.087937 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8b8247ce-b03c-4787-ba5a-5bc0f0c093e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:42.093786 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b8247ce-b03c-4787-ba5a-5bc0f0c093e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:42.094339 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b8247ce-b03c-4787-ba5a-5bc0f0c093e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:42.095238 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b8247ce-b03c-4787-ba5a-5bc0f0c093e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:42.095696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8b8247ce-b03c-4787-ba5a-5bc0f0c093e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:42.193419 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-24d35930-c751-44f1-b955-236deceafdf8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:42.202183 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-24d35930-c751-44f1-b955-236deceafdf8 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.170718 Aug 30 07:51:42.211397 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 328/696] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:42 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:42.213954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8b8247ce-b03c-4787-ba5a-5bc0f0c093e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.129920 Aug 30 07:51:42.214651 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 369/697] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:42 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:42.407991 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ef59c761-37c0-48e9-9f6c-250af50ca64b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:42.409450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ef59c761-37c0-48e9-9f6c-250af50ca64b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:42.416095 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef59c761-37c0-48e9-9f6c-250af50ca64b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:42.416619 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef59c761-37c0-48e9-9f6c-250af50ca64b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:42.417471 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef59c761-37c0-48e9-9f6c-250af50ca64b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:42.417980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef59c761-37c0-48e9-9f6c-250af50ca64b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:42.519490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ef59c761-37c0-48e9-9f6c-250af50ca64b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.116214 Aug 30 07:51:42.520128 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 329/698] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:42 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:42.579981 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-25b2550b-d52c-412c-bcb7-2b486b60bf55 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:42.582127 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-25b2550b-d52c-412c-bcb7-2b486b60bf55 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:42.589147 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-25b2550b-d52c-412c-bcb7-2b486b60bf55 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:42.589688 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-25b2550b-d52c-412c-bcb7-2b486b60bf55 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:42.590523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-25b2550b-d52c-412c-bcb7-2b486b60bf55 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:42.590963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-25b2550b-d52c-412c-bcb7-2b486b60bf55 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:42.622245 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-25b2550b-d52c-412c-bcb7-2b486b60bf55 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046487 Aug 30 07:51:42.623073 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 370/699] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:42 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:43.219228 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b3a183f0-8f4d-444a-b942-dcaa746aa7c0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:43.225295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-11ad6538-8e14-4bba-80d6-7761e12865c2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:43.226384 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-11ad6538-8e14-4bba-80d6-7761e12865c2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:43.227318 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b3a183f0-8f4d-444a-b942-dcaa746aa7c0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:43.232655 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-11ad6538-8e14-4bba-80d6-7761e12865c2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:43.233190 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-11ad6538-8e14-4bba-80d6-7761e12865c2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:43.233963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-11ad6538-8e14-4bba-80d6-7761e12865c2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:43.234592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-11ad6538-8e14-4bba-80d6-7761e12865c2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:43.238598 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b3a183f0-8f4d-444a-b942-dcaa746aa7c0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:43.240531 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b3a183f0-8f4d-444a-b942-dcaa746aa7c0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:43.242265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b3a183f0-8f4d-444a-b942-dcaa746aa7c0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:43.242265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b3a183f0-8f4d-444a-b942-dcaa746aa7c0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:43.385561 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b3a183f0-8f4d-444a-b942-dcaa746aa7c0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:43.393265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b3a183f0-8f4d-444a-b942-dcaa746aa7c0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.177995 Aug 30 07:51:43.393857 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 330/700] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:43 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:43.477929 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-11ad6538-8e14-4bba-80d6-7761e12865c2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.256833 Aug 30 07:51:43.478596 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 371/701] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:43 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:43.530809 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b0158e50-9047-4ed9-bbe9-2d591a00df37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:43.531730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b0158e50-9047-4ed9-bbe9-2d591a00df37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:43.538510 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0158e50-9047-4ed9-bbe9-2d591a00df37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:43.538994 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0158e50-9047-4ed9-bbe9-2d591a00df37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:43.539870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0158e50-9047-4ed9-bbe9-2d591a00df37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:43.540369 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0158e50-9047-4ed9-bbe9-2d591a00df37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:43.615806 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b0158e50-9047-4ed9-bbe9-2d591a00df37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.088429 Aug 30 07:51:43.616976 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 331/702] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:43 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:51:43.636153 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-89e2327b-7ee3-45d8-9877-11fcadfd6611 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:43.637502 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-89e2327b-7ee3-45d8-9877-11fcadfd6611 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:43.645332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89e2327b-7ee3-45d8-9877-11fcadfd6611 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:43.645697 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89e2327b-7ee3-45d8-9877-11fcadfd6611 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:43.646613 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89e2327b-7ee3-45d8-9877-11fcadfd6611 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:43.647044 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89e2327b-7ee3-45d8-9877-11fcadfd6611 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:43.679302 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-89e2327b-7ee3-45d8-9877-11fcadfd6611 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048242 Aug 30 07:51:43.679864 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 372/703] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:43 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:51:44.413803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-17f9aed0-aa4c-4fde-a96b-22c208f87a69 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:44.414532 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-17f9aed0-aa4c-4fde-a96b-22c208f87a69 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:44.421317 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-17f9aed0-aa4c-4fde-a96b-22c208f87a69 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:44.421997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-17f9aed0-aa4c-4fde-a96b-22c208f87a69 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:44.422949 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-17f9aed0-aa4c-4fde-a96b-22c208f87a69 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:44.423480 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-17f9aed0-aa4c-4fde-a96b-22c208f87a69 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:44.489007 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b0d24fad-134d-495a-8789-4be03ec780bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:44.490697 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b0d24fad-134d-495a-8789-4be03ec780bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:44.501067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0d24fad-134d-495a-8789-4be03ec780bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:44.501067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0d24fad-134d-495a-8789-4be03ec780bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:44.501067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0d24fad-134d-495a-8789-4be03ec780bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:44.501067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0d24fad-134d-495a-8789-4be03ec780bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:44.551307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-17f9aed0-aa4c-4fde-a96b-22c208f87a69 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:44.559209 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-17f9aed0-aa4c-4fde-a96b-22c208f87a69 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.150738 Aug 30 07:51:44.564412 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 332/704] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:44 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:44.578227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b0d24fad-134d-495a-8789-4be03ec780bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.092795 Aug 30 07:51:44.579116 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 373/705] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:44 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:44.630712 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-21050277-118d-4c09-8319-62edc837834c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:44.632372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-21050277-118d-4c09-8319-62edc837834c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:44.638797 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21050277-118d-4c09-8319-62edc837834c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:44.639253 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21050277-118d-4c09-8319-62edc837834c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:44.640030 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21050277-118d-4c09-8319-62edc837834c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:44.640462 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21050277-118d-4c09-8319-62edc837834c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:44.838188 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-21050277-118d-4c09-8319-62edc837834c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.213662 Aug 30 07:51:44.838838 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 333/706] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:44 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:51:44.974852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-927c5ffc-0436-44b7-9fd3-d2a936f24542 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:44.975636 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-927c5ffc-0436-44b7-9fd3-d2a936f24542 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:44.985040 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-927c5ffc-0436-44b7-9fd3-d2a936f24542 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:44.985492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-927c5ffc-0436-44b7-9fd3-d2a936f24542 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:44.986321 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-927c5ffc-0436-44b7-9fd3-d2a936f24542 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:44.986753 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-927c5ffc-0436-44b7-9fd3-d2a936f24542 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:45.014136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-927c5ffc-0436-44b7-9fd3-d2a936f24542 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:51:45.096209 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-927c5ffc-0436-44b7-9fd3-d2a936f24542 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "DELETE /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 204 len: 0 microversion: 2.1 time: 0.125535 Aug 30 07:51:45.098620 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 374/707] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:51:44 2021] DELETE /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 07:51:45.107244 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-43867071-8aaa-460b-9550-2b07a21a32a3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:45.108180 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-43867071-8aaa-460b-9550-2b07a21a32a3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:45.116286 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-43867071-8aaa-460b-9550-2b07a21a32a3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:45.117082 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-43867071-8aaa-460b-9550-2b07a21a32a3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:45.118103 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-43867071-8aaa-460b-9550-2b07a21a32a3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:45.118777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-43867071-8aaa-460b-9550-2b07a21a32a3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:45.256090 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-43867071-8aaa-460b-9550-2b07a21a32a3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:45.266464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-43867071-8aaa-460b-9550-2b07a21a32a3 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1514 microversion: 2.1 time: 0.163299 Aug 30 07:51:45.267288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 334/708] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:45 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:45.577333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-051c3e55-c171-4415-ae6d-1a4a5655f75c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:45.578041 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-051c3e55-c171-4415-ae6d-1a4a5655f75c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:45.585059 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-051c3e55-c171-4415-ae6d-1a4a5655f75c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:45.585570 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-051c3e55-c171-4415-ae6d-1a4a5655f75c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:45.586311 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-051c3e55-c171-4415-ae6d-1a4a5655f75c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:45.586916 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-051c3e55-c171-4415-ae6d-1a4a5655f75c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:45.590849 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-298a0551-2bfc-4416-b3b6-3fc643bf9492 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:45.591850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-298a0551-2bfc-4416-b3b6-3fc643bf9492 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:45.603240 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-298a0551-2bfc-4416-b3b6-3fc643bf9492 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:45.603700 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-298a0551-2bfc-4416-b3b6-3fc643bf9492 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:45.604486 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-298a0551-2bfc-4416-b3b6-3fc643bf9492 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:45.604919 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-298a0551-2bfc-4416-b3b6-3fc643bf9492 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:45.719756 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-051c3e55-c171-4415-ae6d-1a4a5655f75c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:45.729515 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-051c3e55-c171-4415-ae6d-1a4a5655f75c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.156251 Aug 30 07:51:45.730224 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 375/709] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:45 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:45.850601 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b87ba1a3-ed0a-4bce-b756-55cb3646d19d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:45.851315 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b87ba1a3-ed0a-4bce-b756-55cb3646d19d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:45.857046 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b87ba1a3-ed0a-4bce-b756-55cb3646d19d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:45.857500 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b87ba1a3-ed0a-4bce-b756-55cb3646d19d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:45.858299 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b87ba1a3-ed0a-4bce-b756-55cb3646d19d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:45.858738 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b87ba1a3-ed0a-4bce-b756-55cb3646d19d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:45.980878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b87ba1a3-ed0a-4bce-b756-55cb3646d19d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.134621 Aug 30 07:51:45.981664 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 376/710] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:45 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:51:46.001132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-298a0551-2bfc-4416-b3b6-3fc643bf9492 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.413725 Aug 30 07:51:46.001837 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 335/711] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:45 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:46.285130 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-871a747d-e6c8-4628-9122-4d3918120200 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:46.285845 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-871a747d-e6c8-4628-9122-4d3918120200 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:46.292466 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-871a747d-e6c8-4628-9122-4d3918120200 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:46.292910 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-871a747d-e6c8-4628-9122-4d3918120200 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:46.293715 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-871a747d-e6c8-4628-9122-4d3918120200 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:46.294237 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-871a747d-e6c8-4628-9122-4d3918120200 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:46.425282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-871a747d-e6c8-4628-9122-4d3918120200 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:46.434114 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-871a747d-e6c8-4628-9122-4d3918120200 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1514 microversion: 2.1 time: 0.153541 Aug 30 07:51:46.434784 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 377/712] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:46 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:46.748076 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-34ae877f-67ce-4c1f-ac50-18394b7da14a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:46.748838 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-34ae877f-67ce-4c1f-ac50-18394b7da14a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:46.755877 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34ae877f-67ce-4c1f-ac50-18394b7da14a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:46.756329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34ae877f-67ce-4c1f-ac50-18394b7da14a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:46.757112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34ae877f-67ce-4c1f-ac50-18394b7da14a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:46.757546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34ae877f-67ce-4c1f-ac50-18394b7da14a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:46.886360 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-34ae877f-67ce-4c1f-ac50-18394b7da14a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:46.894548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-34ae877f-67ce-4c1f-ac50-18394b7da14a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1568 microversion: 2.1 time: 0.150801 Aug 30 07:51:46.895101 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 336/713] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:46 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:46.992781 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-841567da-383e-4efa-9e23-7eb6f58093cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:46.993748 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-841567da-383e-4efa-9e23-7eb6f58093cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:46.999863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-841567da-383e-4efa-9e23-7eb6f58093cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:47.000297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-841567da-383e-4efa-9e23-7eb6f58093cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:47.001051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-841567da-383e-4efa-9e23-7eb6f58093cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:47.001474 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-841567da-383e-4efa-9e23-7eb6f58093cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:47.054309 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-65f40540-3b0a-4524-8e36-d2ada9307886 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:47.055143 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-65f40540-3b0a-4524-8e36-d2ada9307886 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:47.060980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65f40540-3b0a-4524-8e36-d2ada9307886 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:47.061430 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65f40540-3b0a-4524-8e36-d2ada9307886 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:47.062214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65f40540-3b0a-4524-8e36-d2ada9307886 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:47.062650 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65f40540-3b0a-4524-8e36-d2ada9307886 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:47.084597 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-841567da-383e-4efa-9e23-7eb6f58093cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.095277 Aug 30 07:51:47.085233 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 378/714] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:46 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:47.162803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-65f40540-3b0a-4524-8e36-d2ada9307886 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.112080 Aug 30 07:51:47.163681 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 337/715] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:47 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:47.451793 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dbb7d615-3fc1-4629-a0fd-4b4a2e11a7f5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:47.452493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dbb7d615-3fc1-4629-a0fd-4b4a2e11a7f5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:47.459420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbb7d615-3fc1-4629-a0fd-4b4a2e11a7f5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:47.459871 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbb7d615-3fc1-4629-a0fd-4b4a2e11a7f5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:47.460629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbb7d615-3fc1-4629-a0fd-4b4a2e11a7f5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:47.461057 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbb7d615-3fc1-4629-a0fd-4b4a2e11a7f5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:47.587188 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-dbb7d615-3fc1-4629-a0fd-4b4a2e11a7f5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:47.594483 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dbb7d615-3fc1-4629-a0fd-4b4a2e11a7f5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1514 microversion: 2.1 time: 0.146816 Aug 30 07:51:47.595048 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 379/716] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:47 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:47.911991 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c5122a8f-e23d-408c-bc18-871e9a0b586a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:47.912680 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c5122a8f-e23d-408c-bc18-871e9a0b586a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:47.919105 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5122a8f-e23d-408c-bc18-871e9a0b586a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:47.919547 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5122a8f-e23d-408c-bc18-871e9a0b586a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:47.920298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5122a8f-e23d-408c-bc18-871e9a0b586a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:47.920727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c5122a8f-e23d-408c-bc18-871e9a0b586a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.043512 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c5122a8f-e23d-408c-bc18-871e9a0b586a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:48.052016 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c5122a8f-e23d-408c-bc18-871e9a0b586a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1548 microversion: 2.1 time: 0.144561 Aug 30 07:51:48.052577 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 338/717] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:47 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:48.068007 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-48e4e1ef-348e-4e8c-a074-deae4523afd3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:48.068564 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-48e4e1ef-348e-4e8c-a074-deae4523afd3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:48.074320 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-48e4e1ef-348e-4e8c-a074-deae4523afd3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.074770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-48e4e1ef-348e-4e8c-a074-deae4523afd3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.075585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-48e4e1ef-348e-4e8c-a074-deae4523afd3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.075969 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-48e4e1ef-348e-4e8c-a074-deae4523afd3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.096121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6250c7e1-b97f-4f6b-b0bc-e166e38659e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:48.097760 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6250c7e1-b97f-4f6b-b0bc-e166e38659e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:48.103649 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6250c7e1-b97f-4f6b-b0bc-e166e38659e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.104073 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6250c7e1-b97f-4f6b-b0bc-e166e38659e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.104830 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6250c7e1-b97f-4f6b-b0bc-e166e38659e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.105266 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6250c7e1-b97f-4f6b-b0bc-e166e38659e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.203969 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-48e4e1ef-348e-4e8c-a074-deae4523afd3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] HTTP exception thrown: Cannot 'detach_volume' instance 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 while it is in vm_state rescued Aug 30 07:51:48.204566 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-48e4e1ef-348e-4e8c-a074-deae4523afd3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Returning 409 to user: Cannot 'detach_volume' instance 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 while it is in vm_state rescued {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:51:48.205406 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-48e4e1ef-348e-4e8c-a074-deae4523afd3 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "DELETE /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments/341c3c39-b451-4b9b-953e-d9b115d3899f" status: 409 len: 152 microversion: 2.1 time: 0.141456 Aug 30 07:51:48.206487 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 380/718] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:51:48 2021] DELETE /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments/341c3c39-b451-4b9b-953e-d9b115d3899f => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 07:51:48.211218 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5f825a9d-5bc2-4d3d-a3cd-994de87cc7d3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:48.212131 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5f825a9d-5bc2-4d3d-a3cd-994de87cc7d3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:48.214248 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6250c7e1-b97f-4f6b-b0bc-e166e38659e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.121578 Aug 30 07:51:48.215199 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 339/719] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:48 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:51:48.218876 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5f825a9d-5bc2-4d3d-a3cd-994de87cc7d3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.219324 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5f825a9d-5bc2-4d3d-a3cd-994de87cc7d3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.220098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5f825a9d-5bc2-4d3d-a3cd-994de87cc7d3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.220498 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e965f7af-ae12-4868-b9b2-6e8c26e691d2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:48.220614 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5f825a9d-5bc2-4d3d-a3cd-994de87cc7d3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.221126 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e965f7af-ae12-4868-b9b2-6e8c26e691d2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:48.228535 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e965f7af-ae12-4868-b9b2-6e8c26e691d2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.228711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e965f7af-ae12-4868-b9b2-6e8c26e691d2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.229439 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e965f7af-ae12-4868-b9b2-6e8c26e691d2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.229871 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e965f7af-ae12-4868-b9b2-6e8c26e691d2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.295174 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e965f7af-ae12-4868-b9b2-6e8c26e691d2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/action" status: 202 len: 0 microversion: 2.1 time: 0.078742 Aug 30 07:51:48.295801 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 340/720] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:48 2021] POST /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:48.303959 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6930ff4f-036b-41bc-9548-13bae88c0361 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:48.304655 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6930ff4f-036b-41bc-9548-13bae88c0361 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:48.310793 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6930ff4f-036b-41bc-9548-13bae88c0361 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.311240 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6930ff4f-036b-41bc-9548-13bae88c0361 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.312011 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6930ff4f-036b-41bc-9548-13bae88c0361 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.312445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6930ff4f-036b-41bc-9548-13bae88c0361 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.417946 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5f825a9d-5bc2-4d3d-a3cd-994de87cc7d3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.210050 Aug 30 07:51:48.418919 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 381/721] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:48 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:48.543470 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6930ff4f-036b-41bc-9548-13bae88c0361 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:48.551438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6930ff4f-036b-41bc-9548-13bae88c0361 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1556 microversion: 2.1 time: 0.251168 Aug 30 07:51:48.552042 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 341/722] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:48 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:48.612145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6cc3b414-5686-4cfe-a651-538e059d9b5d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:48.613202 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6cc3b414-5686-4cfe-a651-538e059d9b5d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:48.620050 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6cc3b414-5686-4cfe-a651-538e059d9b5d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.620493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6cc3b414-5686-4cfe-a651-538e059d9b5d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.621283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6cc3b414-5686-4cfe-a651-538e059d9b5d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:48.621688 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6cc3b414-5686-4cfe-a651-538e059d9b5d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:48.744872 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6cc3b414-5686-4cfe-a651-538e059d9b5d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:48.752373 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6cc3b414-5686-4cfe-a651-538e059d9b5d tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1514 microversion: 2.1 time: 0.144656 Aug 30 07:51:48.753437 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 382/723] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:48 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:49.226674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5ce72145-1ba2-472a-a6d9-7981f4b1e38c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:49.227640 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5ce72145-1ba2-472a-a6d9-7981f4b1e38c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:49.234305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5ce72145-1ba2-472a-a6d9-7981f4b1e38c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:49.234928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5ce72145-1ba2-472a-a6d9-7981f4b1e38c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:49.235701 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5ce72145-1ba2-472a-a6d9-7981f4b1e38c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:49.236237 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5ce72145-1ba2-472a-a6d9-7981f4b1e38c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:49.261033 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-13e795bf-4de7-492d-ae8f-b7269ffbf638 req-63cb2283-e3a8-4236-a03a-0cb1bac1d341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178ce678-fdfa-4447-8572-f084fb7b273b", "name": "network-vif-deleted", "tag": "13b629f3-ca48-4386-acd8-de3370618d1c"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:49.263184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:51:49.263184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:51:49.270228 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-13e795bf-4de7-492d-ae8f-b7269ffbf638 req-63cb2283-e3a8-4236-a03a-0cb1bac1d341 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:49.270950 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-13e795bf-4de7-492d-ae8f-b7269ffbf638 req-63cb2283-e3a8-4236-a03a-0cb1bac1d341 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:49.283554 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-13e795bf-4de7-492d-ae8f-b7269ffbf638 req-63cb2283-e3a8-4236-a03a-0cb1bac1d341 service nova] Creating event network-vif-deleted:13b629f3-ca48-4386-acd8-de3370618d1c for instance 178ce678-fdfa-4447-8572-f084fb7b273b on hv-cinder-80619 Aug 30 07:51:49.289144 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-13e795bf-4de7-492d-ae8f-b7269ffbf638 req-63cb2283-e3a8-4236-a03a-0cb1bac1d341 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031603 Aug 30 07:51:49.289853 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 383/724] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:51:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:51:49.341831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5ce72145-1ba2-472a-a6d9-7981f4b1e38c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.118499 Aug 30 07:51:49.342575 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 342/725] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:49 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:49.431739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-32fe0f81-2f24-4950-ae8c-87dcb7d32a84 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:49.432988 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-32fe0f81-2f24-4950-ae8c-87dcb7d32a84 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:49.440431 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32fe0f81-2f24-4950-ae8c-87dcb7d32a84 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:49.441174 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32fe0f81-2f24-4950-ae8c-87dcb7d32a84 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:49.441739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32fe0f81-2f24-4950-ae8c-87dcb7d32a84 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:49.442194 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32fe0f81-2f24-4950-ae8c-87dcb7d32a84 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:49.569324 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f51e220b-1411-4e9a-9add-67a2886cc469 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:49.569935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f51e220b-1411-4e9a-9add-67a2886cc469 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:49.576406 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f51e220b-1411-4e9a-9add-67a2886cc469 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:49.576850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f51e220b-1411-4e9a-9add-67a2886cc469 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:49.577617 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f51e220b-1411-4e9a-9add-67a2886cc469 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:49.578050 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f51e220b-1411-4e9a-9add-67a2886cc469 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:49.679157 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-32fe0f81-2f24-4950-ae8c-87dcb7d32a84 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.251796 Aug 30 07:51:49.679809 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 384/726] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:49 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:49.703914 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f51e220b-1411-4e9a-9add-67a2886cc469 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:49.713557 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f51e220b-1411-4e9a-9add-67a2886cc469 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1556 microversion: 2.1 time: 0.148680 Aug 30 07:51:49.714124 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 343/727] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:49 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:49.770995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5b27e4d6-54b9-4a87-9200-508700d91a05 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:49.771694 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5b27e4d6-54b9-4a87-9200-508700d91a05 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:49.778322 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b27e4d6-54b9-4a87-9200-508700d91a05 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:49.778774 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b27e4d6-54b9-4a87-9200-508700d91a05 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:49.779548 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b27e4d6-54b9-4a87-9200-508700d91a05 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:49.779985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b27e4d6-54b9-4a87-9200-508700d91a05 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:49.810757 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b27e4d6-54b9-4a87-9200-508700d91a05 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:49.811205 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b27e4d6-54b9-4a87-9200-508700d91a05 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:49.811653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-5b27e4d6-54b9-4a87-9200-508700d91a05 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lazy-loading 'fault' on Instance uuid 178ce678-fdfa-4447-8572-f084fb7b273b {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:51:49.855053 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5b27e4d6-54b9-4a87-9200-508700d91a05 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:49.862448 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5b27e4d6-54b9-4a87-9200-508700d91a05 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 200 len: 1308 microversion: 2.1 time: 0.096299 Aug 30 07:51:49.863011 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 385/728] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:49 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:50.353420 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4f50512b-61a0-40ee-9d20-78d301865cca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:50.354367 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4f50512b-61a0-40ee-9d20-78d301865cca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:50.360306 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f50512b-61a0-40ee-9d20-78d301865cca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:50.360754 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f50512b-61a0-40ee-9d20-78d301865cca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:50.361523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f50512b-61a0-40ee-9d20-78d301865cca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:50.362502 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f50512b-61a0-40ee-9d20-78d301865cca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:50.574906 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4f50512b-61a0-40ee-9d20-78d301865cca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.225035 Aug 30 07:51:50.575556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 344/729] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:50 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:50.691264 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-05139902-cf15-4e63-8d79-176e6de44136 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:50.692099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-05139902-cf15-4e63-8d79-176e6de44136 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:50.697913 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-05139902-cf15-4e63-8d79-176e6de44136 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:50.698426 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-05139902-cf15-4e63-8d79-176e6de44136 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:50.699191 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-05139902-cf15-4e63-8d79-176e6de44136 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:50.699622 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-05139902-cf15-4e63-8d79-176e6de44136 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:50.732047 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-79094be3-81f5-468b-ac75-e142ef2b0c3f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:50.732730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-79094be3-81f5-468b-ac75-e142ef2b0c3f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:50.739760 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79094be3-81f5-468b-ac75-e142ef2b0c3f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:50.740199 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79094be3-81f5-468b-ac75-e142ef2b0c3f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:50.740956 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79094be3-81f5-468b-ac75-e142ef2b0c3f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:50.741385 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79094be3-81f5-468b-ac75-e142ef2b0c3f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:50.791931 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-05139902-cf15-4e63-8d79-176e6de44136 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.104953 Aug 30 07:51:50.792696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 386/730] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:50 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:50.864346 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-79094be3-81f5-468b-ac75-e142ef2b0c3f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:50.872049 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-79094be3-81f5-468b-ac75-e142ef2b0c3f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1556 microversion: 2.1 time: 0.144008 Aug 30 07:51:50.872872 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 345/731] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:50 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1556 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:50.878857 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0868417e-0e5e-4393-a99b-a1c67480a108 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:50.879562 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0868417e-0e5e-4393-a99b-a1c67480a108 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 178ce678-fdfa-4447-8572-f084fb7b273b] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:50.885958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0868417e-0e5e-4393-a99b-a1c67480a108 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:50.886435 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0868417e-0e5e-4393-a99b-a1c67480a108 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:50.887196 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0868417e-0e5e-4393-a99b-a1c67480a108 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:50.887626 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0868417e-0e5e-4393-a99b-a1c67480a108 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:50.901027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-0868417e-0e5e-4393-a99b-a1c67480a108 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] HTTP exception thrown: Instance 178ce678-fdfa-4447-8572-f084fb7b273b could not be found. Aug 30 07:51:50.901612 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0868417e-0e5e-4393-a99b-a1c67480a108 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Returning 404 to user: Instance 178ce678-fdfa-4447-8572-f084fb7b273b could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:51:50.902507 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0868417e-0e5e-4393-a99b-a1c67480a108 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b" status: 404 len: 111 microversion: 2.1 time: 0.027658 Aug 30 07:51:50.903021 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 387/732] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:50 2021] GET /compute/v2.1/servers/178ce678-fdfa-4447-8572-f084fb7b273b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:51:51.586786 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ed4a9266-e922-41fa-b72f-b588d3a194cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:51.587601 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ed4a9266-e922-41fa-b72f-b588d3a194cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:51.593407 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed4a9266-e922-41fa-b72f-b588d3a194cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:51.593849 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed4a9266-e922-41fa-b72f-b588d3a194cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:51.594624 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed4a9266-e922-41fa-b72f-b588d3a194cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:51.595048 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed4a9266-e922-41fa-b72f-b588d3a194cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:51.678928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ed4a9266-e922-41fa-b72f-b588d3a194cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.095727 Aug 30 07:51:51.679571 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 346/733] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:51 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:51.804256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7d3991f5-0f43-4612-9115-88a8f178dd7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:51.805167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7d3991f5-0f43-4612-9115-88a8f178dd7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:51.810913 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7d3991f5-0f43-4612-9115-88a8f178dd7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:51.811357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7d3991f5-0f43-4612-9115-88a8f178dd7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:51.812109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7d3991f5-0f43-4612-9115-88a8f178dd7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:51.812542 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7d3991f5-0f43-4612-9115-88a8f178dd7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:51.889102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6a010c98-b105-40a3-9ef8-7de09e412009 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:51.889813 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6a010c98-b105-40a3-9ef8-7de09e412009 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:51.896209 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6a010c98-b105-40a3-9ef8-7de09e412009 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:51.896652 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6a010c98-b105-40a3-9ef8-7de09e412009 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:51.897415 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6a010c98-b105-40a3-9ef8-7de09e412009 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:51.897833 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6a010c98-b105-40a3-9ef8-7de09e412009 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:51.906812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7d3991f5-0f43-4612-9115-88a8f178dd7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.106107 Aug 30 07:51:51.907445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 388/734] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:51 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:52.019440 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6a010c98-b105-40a3-9ef8-7de09e412009 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:52.027286 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6a010c98-b105-40a3-9ef8-7de09e412009 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1556 microversion: 2.1 time: 0.142158 Aug 30 07:51:52.027856 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 347/735] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:51 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1556 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:52.040380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-01dc5693-98e7-4900-8c0f-9889d2a43327 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:52.040957 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-01dc5693-98e7-4900-8c0f-9889d2a43327 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:52.047433 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01dc5693-98e7-4900-8c0f-9889d2a43327 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:52.047874 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01dc5693-98e7-4900-8c0f-9889d2a43327 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:52.048630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01dc5693-98e7-4900-8c0f-9889d2a43327 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:52.049082 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01dc5693-98e7-4900-8c0f-9889d2a43327 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:52.074314 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-01dc5693-98e7-4900-8c0f-9889d2a43327 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:51:52.149827 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-01dc5693-98e7-4900-8c0f-9889d2a43327 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 204 len: 0 microversion: 2.1 time: 0.113058 Aug 30 07:51:52.150398 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 389/736] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:51:52 2021] DELETE /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:51:52.159609 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a06e3f93-88cb-48c9-a17e-f4caf0e10f1b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:52.160253 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a06e3f93-88cb-48c9-a17e-f4caf0e10f1b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:52.165923 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a06e3f93-88cb-48c9-a17e-f4caf0e10f1b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:52.166396 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a06e3f93-88cb-48c9-a17e-f4caf0e10f1b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:52.167153 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a06e3f93-88cb-48c9-a17e-f4caf0e10f1b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:52.167578 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a06e3f93-88cb-48c9-a17e-f4caf0e10f1b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:52.286369 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a06e3f93-88cb-48c9-a17e-f4caf0e10f1b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:52.294251 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a06e3f93-88cb-48c9-a17e-f4caf0e10f1b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1514 microversion: 2.1 time: 0.139533 Aug 30 07:51:52.294820 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 348/737] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:52 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1514 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:52.691722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-79163a4f-70ee-4409-87de-57cc7fbffe14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:52.692715 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-79163a4f-70ee-4409-87de-57cc7fbffe14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:52.698531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-79163a4f-70ee-4409-87de-57cc7fbffe14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:52.698980 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-79163a4f-70ee-4409-87de-57cc7fbffe14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:52.699736 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-79163a4f-70ee-4409-87de-57cc7fbffe14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:52.700164 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-79163a4f-70ee-4409-87de-57cc7fbffe14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:52.783334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-79163a4f-70ee-4409-87de-57cc7fbffe14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.095860 Aug 30 07:51:52.784713 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 390/738] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:52 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:52.918517 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-59801fdc-a2a9-4dc5-99d4-452fb660bb82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:52.919435 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-59801fdc-a2a9-4dc5-99d4-452fb660bb82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:52.925592 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59801fdc-a2a9-4dc5-99d4-452fb660bb82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:52.926025 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59801fdc-a2a9-4dc5-99d4-452fb660bb82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:52.926877 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59801fdc-a2a9-4dc5-99d4-452fb660bb82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:52.927308 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59801fdc-a2a9-4dc5-99d4-452fb660bb82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:53.025852 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-59801fdc-a2a9-4dc5-99d4-452fb660bb82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.110781 Aug 30 07:51:53.026537 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 349/739] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:52 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:53.046121 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-197ca870-b640-4668-b012-4d8920da984f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:53.046849 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-197ca870-b640-4668-b012-4d8920da984f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:53.053461 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-197ca870-b640-4668-b012-4d8920da984f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:53.053907 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-197ca870-b640-4668-b012-4d8920da984f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:53.054699 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-197ca870-b640-4668-b012-4d8920da984f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:53.055138 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-197ca870-b640-4668-b012-4d8920da984f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:53.177574 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-197ca870-b640-4668-b012-4d8920da984f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:53.185257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-197ca870-b640-4668-b012-4d8920da984f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1556 microversion: 2.1 time: 0.144307 Aug 30 07:51:53.185815 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 391/740] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:53 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1556 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:53.312834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8128315c-b3d0-4178-b48c-2f2180d172b0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:53.313556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8128315c-b3d0-4178-b48c-2f2180d172b0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:53.320288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8128315c-b3d0-4178-b48c-2f2180d172b0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:53.320732 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8128315c-b3d0-4178-b48c-2f2180d172b0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:53.321484 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8128315c-b3d0-4178-b48c-2f2180d172b0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:53.322093 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8128315c-b3d0-4178-b48c-2f2180d172b0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:53.446320 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8128315c-b3d0-4178-b48c-2f2180d172b0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:53.453424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8128315c-b3d0-4178-b48c-2f2180d172b0 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1514 microversion: 2.1 time: 0.144598 Aug 30 07:51:53.453981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 350/741] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:53 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:53.795762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e52460d0-387c-48e4-b9dc-e58857754209 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:53.796723 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e52460d0-387c-48e4-b9dc-e58857754209 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:53.802561 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e52460d0-387c-48e4-b9dc-e58857754209 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:53.802999 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e52460d0-387c-48e4-b9dc-e58857754209 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:53.803750 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e52460d0-387c-48e4-b9dc-e58857754209 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:53.804174 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e52460d0-387c-48e4-b9dc-e58857754209 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:54.014785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e52460d0-387c-48e4-b9dc-e58857754209 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.222394 Aug 30 07:51:54.015426 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 392/742] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:53 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:54.038567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1060042c-9e69-45d3-b807-2f4e39954f7d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:54.039496 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1060042c-9e69-45d3-b807-2f4e39954f7d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:54.045238 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1060042c-9e69-45d3-b807-2f4e39954f7d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:54.045685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1060042c-9e69-45d3-b807-2f4e39954f7d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:54.046480 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1060042c-9e69-45d3-b807-2f4e39954f7d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:54.046917 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1060042c-9e69-45d3-b807-2f4e39954f7d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:54.185289 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1060042c-9e69-45d3-b807-2f4e39954f7d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.151966 Aug 30 07:51:54.185943 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 351/743] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:54 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:54.203740 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ce994f4f-482f-4d1e-ba97-928dfdf19d8b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:54.204822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ce994f4f-482f-4d1e-ba97-928dfdf19d8b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:54.212217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce994f4f-482f-4d1e-ba97-928dfdf19d8b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:54.212672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce994f4f-482f-4d1e-ba97-928dfdf19d8b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:54.213493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce994f4f-482f-4d1e-ba97-928dfdf19d8b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:54.213936 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce994f4f-482f-4d1e-ba97-928dfdf19d8b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:54.342201 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ce994f4f-482f-4d1e-ba97-928dfdf19d8b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:54.350670 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ce994f4f-482f-4d1e-ba97-928dfdf19d8b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1556 microversion: 2.1 time: 0.151981 Aug 30 07:51:54.351236 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 393/744] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:54 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:54.470422 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4670bb0b-aebb-498a-86a5-a3e8a6215b36 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:54.471597 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4670bb0b-aebb-498a-86a5-a3e8a6215b36 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:54.478000 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4670bb0b-aebb-498a-86a5-a3e8a6215b36 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:54.478472 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4670bb0b-aebb-498a-86a5-a3e8a6215b36 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:54.479224 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4670bb0b-aebb-498a-86a5-a3e8a6215b36 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:54.479651 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4670bb0b-aebb-498a-86a5-a3e8a6215b36 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:54.600887 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4670bb0b-aebb-498a-86a5-a3e8a6215b36 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:54.608074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4670bb0b-aebb-498a-86a5-a3e8a6215b36 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1514 microversion: 2.1 time: 0.141681 Aug 30 07:51:54.608636 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 352/745] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:54 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1514 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:55.028373 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-35f2b0f5-d4d6-4502-aeb2-2b7ce301c49e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:55.029309 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-35f2b0f5-d4d6-4502-aeb2-2b7ce301c49e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:55.035902 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35f2b0f5-d4d6-4502-aeb2-2b7ce301c49e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.036342 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35f2b0f5-d4d6-4502-aeb2-2b7ce301c49e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.037098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35f2b0f5-d4d6-4502-aeb2-2b7ce301c49e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.037523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35f2b0f5-d4d6-4502-aeb2-2b7ce301c49e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.161051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-35f2b0f5-d4d6-4502-aeb2-2b7ce301c49e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.136184 Aug 30 07:51:55.161721 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 394/746] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:55 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:55.196677 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7f300bc1-18be-45f1-a2f1-cdce761fa9c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:55.197593 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7f300bc1-18be-45f1-a2f1-cdce761fa9c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:55.203227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f300bc1-18be-45f1-a2f1-cdce761fa9c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.203666 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f300bc1-18be-45f1-a2f1-cdce761fa9c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.204424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f300bc1-18be-45f1-a2f1-cdce761fa9c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.204992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f300bc1-18be-45f1-a2f1-cdce761fa9c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.277820 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7f300bc1-18be-45f1-a2f1-cdce761fa9c1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.084556 Aug 30 07:51:55.278628 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 353/747] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:55 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:55.368350 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c76ef865-6755-4d16-8758-d8bb9615757e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:55.369043 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c76ef865-6755-4d16-8758-d8bb9615757e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:55.375586 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c76ef865-6755-4d16-8758-d8bb9615757e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.376030 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c76ef865-6755-4d16-8758-d8bb9615757e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.376797 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c76ef865-6755-4d16-8758-d8bb9615757e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.377829 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c76ef865-6755-4d16-8758-d8bb9615757e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.505994 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c76ef865-6755-4d16-8758-d8bb9615757e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:55.513930 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c76ef865-6755-4d16-8758-d8bb9615757e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1562 microversion: 2.1 time: 0.149609 Aug 30 07:51:55.514529 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 395/748] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:55 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:55.586011 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f413cc1c-485f-4ccd-9650-2063453fe5c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:55.586618 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f413cc1c-485f-4ccd-9650-2063453fe5c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:55.593046 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f413cc1c-485f-4ccd-9650-2063453fe5c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.593492 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f413cc1c-485f-4ccd-9650-2063453fe5c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.594290 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f413cc1c-485f-4ccd-9650-2063453fe5c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.594725 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f413cc1c-485f-4ccd-9650-2063453fe5c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.625863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c87dc6ac-ceab-421a-b349-2d38c931ce6a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:55.627106 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c87dc6ac-ceab-421a-b349-2d38c931ce6a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:55.633949 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c87dc6ac-ceab-421a-b349-2d38c931ce6a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.634494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c87dc6ac-ceab-421a-b349-2d38c931ce6a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.635335 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c87dc6ac-ceab-421a-b349-2d38c931ce6a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.635841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c87dc6ac-ceab-421a-b349-2d38c931ce6a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.693920 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-f413cc1c-485f-4ccd-9650-2063453fe5c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lazy-loading 'services' on Instance uuid 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:51:55.771705 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f413cc1c-485f-4ccd-9650-2063453fe5c9 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "DELETE /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments/341c3c39-b451-4b9b-953e-d9b115d3899f" status: 202 len: 0 microversion: 2.1 time: 0.189779 Aug 30 07:51:55.772923 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 354/749] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:51:55 2021] DELETE /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments/341c3c39-b451-4b9b-953e-d9b115d3899f => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:55.785438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5bc05872-e8d7-4f95-8575-6aa84bc85ae0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:55.787331 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5bc05872-e8d7-4f95-8575-6aa84bc85ae0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:55.798675 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5bc05872-e8d7-4f95-8575-6aa84bc85ae0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.799965 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5bc05872-e8d7-4f95-8575-6aa84bc85ae0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.801040 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5bc05872-e8d7-4f95-8575-6aa84bc85ae0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.801761 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5bc05872-e8d7-4f95-8575-6aa84bc85ae0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.802108 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c87dc6ac-ceab-421a-b349-2d38c931ce6a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:55.813035 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c87dc6ac-ceab-421a-b349-2d38c931ce6a tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1514 microversion: 2.1 time: 0.192095 Aug 30 07:51:55.814675 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 396/750] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:55 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:55.836547 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5bc05872-e8d7-4f95-8575-6aa84bc85ae0 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058997 Aug 30 07:51:55.837577 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 355/751] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:55 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:55.923711 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-d4cafe60-5214-46dd-ba18-cfc59d550b3e req-6924983c-6d9a-4239-a7d3-e21940f7439e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b32f1264-9680-449b-a1eb-c42ea5401715", "name": "network-vif-deleted", "tag": "ed47d797-7cde-4038-9cf6-19c7781b0f13"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:55.926768 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:51:55.926768 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:51:55.934397 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-d4cafe60-5214-46dd-ba18-cfc59d550b3e req-6924983c-6d9a-4239-a7d3-e21940f7439e service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:55.934837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-d4cafe60-5214-46dd-ba18-cfc59d550b3e req-6924983c-6d9a-4239-a7d3-e21940f7439e service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:55.953562 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-d4cafe60-5214-46dd-ba18-cfc59d550b3e req-6924983c-6d9a-4239-a7d3-e21940f7439e service nova] Creating event network-vif-deleted:ed47d797-7cde-4038-9cf6-19c7781b0f13 for instance b32f1264-9680-449b-a1eb-c42ea5401715 on hv-cinder-80619 Aug 30 07:51:55.959374 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-d4cafe60-5214-46dd-ba18-cfc59d550b3e req-6924983c-6d9a-4239-a7d3-e21940f7439e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040509 Aug 30 07:51:55.960452 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 397/752] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:51:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:56.172833 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ab9d3cb2-5db7-4cf6-91e4-ab27a476b5f7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:56.173752 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ab9d3cb2-5db7-4cf6-91e4-ab27a476b5f7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:56.180577 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab9d3cb2-5db7-4cf6-91e4-ab27a476b5f7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:56.181021 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab9d3cb2-5db7-4cf6-91e4-ab27a476b5f7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:56.181835 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab9d3cb2-5db7-4cf6-91e4-ab27a476b5f7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:56.182294 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab9d3cb2-5db7-4cf6-91e4-ab27a476b5f7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:56.291946 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4bae5e79-74ac-405c-9bdd-f07ae03a251c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:56.292938 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4bae5e79-74ac-405c-9bdd-f07ae03a251c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:56.299918 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4bae5e79-74ac-405c-9bdd-f07ae03a251c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:56.300360 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4bae5e79-74ac-405c-9bdd-f07ae03a251c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:56.301122 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4bae5e79-74ac-405c-9bdd-f07ae03a251c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:56.301551 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4bae5e79-74ac-405c-9bdd-f07ae03a251c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:56.454446 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ab9d3cb2-5db7-4cf6-91e4-ab27a476b5f7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.285177 Aug 30 07:51:56.455637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 356/753] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:56 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:56.484024 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4bae5e79-74ac-405c-9bdd-f07ae03a251c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.196009 Aug 30 07:51:56.487985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 398/754] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:56 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:56.832047 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-aa135db2-0ceb-4db3-8f92-223fd8408690 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:56.832749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-aa135db2-0ceb-4db3-8f92-223fd8408690 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:56.839817 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa135db2-0ceb-4db3-8f92-223fd8408690 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:56.840518 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa135db2-0ceb-4db3-8f92-223fd8408690 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:56.841301 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa135db2-0ceb-4db3-8f92-223fd8408690 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:56.841743 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa135db2-0ceb-4db3-8f92-223fd8408690 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:56.849950 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-eeec1927-81c8-4d08-adaf-74f40319446a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:56.851431 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-eeec1927-81c8-4d08-adaf-74f40319446a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:56.860045 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eeec1927-81c8-4d08-adaf-74f40319446a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:56.860804 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eeec1927-81c8-4d08-adaf-74f40319446a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:56.861711 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eeec1927-81c8-4d08-adaf-74f40319446a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:56.862515 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eeec1927-81c8-4d08-adaf-74f40319446a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:56.880221 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa135db2-0ceb-4db3-8f92-223fd8408690 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:56.880717 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa135db2-0ceb-4db3-8f92-223fd8408690 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:56.881346 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-aa135db2-0ceb-4db3-8f92-223fd8408690 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lazy-loading 'fault' on Instance uuid b32f1264-9680-449b-a1eb-c42ea5401715 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:51:56.905580 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-eeec1927-81c8-4d08-adaf-74f40319446a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060512 Aug 30 07:51:56.906345 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 399/755] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:56 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:56.928665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-aa135db2-0ceb-4db3-8f92-223fd8408690 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:56.935759 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-aa135db2-0ceb-4db3-8f92-223fd8408690 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 200 len: 1308 microversion: 2.1 time: 0.108352 Aug 30 07:51:56.936348 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 357/756] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:56 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:51:57.466752 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4a5c3eab-44ed-40b7-a662-e000a5148e88 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:57.467833 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4a5c3eab-44ed-40b7-a662-e000a5148e88 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:57.474274 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a5c3eab-44ed-40b7-a662-e000a5148e88 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:57.474739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a5c3eab-44ed-40b7-a662-e000a5148e88 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:57.475506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a5c3eab-44ed-40b7-a662-e000a5148e88 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:57.475940 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4a5c3eab-44ed-40b7-a662-e000a5148e88 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:57.496258 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1bf92619-467e-41d8-bfdf-1c7a07597531 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:57.497468 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1bf92619-467e-41d8-bfdf-1c7a07597531 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:57.503427 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bf92619-467e-41d8-bfdf-1c7a07597531 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:57.503810 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bf92619-467e-41d8-bfdf-1c7a07597531 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:57.504594 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bf92619-467e-41d8-bfdf-1c7a07597531 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:57.505034 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bf92619-467e-41d8-bfdf-1c7a07597531 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:57.554506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4a5c3eab-44ed-40b7-a662-e000a5148e88 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.091315 Aug 30 07:51:57.555149 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 400/757] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:57 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:57.579820 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1bf92619-467e-41d8-bfdf-1c7a07597531 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.087044 Aug 30 07:51:57.580743 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 358/758] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:57 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:51:57.917609 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3130234e-8220-4139-a32b-75622955462d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:57.918631 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3130234e-8220-4139-a32b-75622955462d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:57.925176 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3130234e-8220-4139-a32b-75622955462d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:57.925623 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3130234e-8220-4139-a32b-75622955462d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:57.926404 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3130234e-8220-4139-a32b-75622955462d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:57.926840 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3130234e-8220-4139-a32b-75622955462d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:57.953119 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fde107ad-d2e9-4dd8-beb7-7ebc50981152 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:57.953914 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fde107ad-d2e9-4dd8-beb7-7ebc50981152 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: b32f1264-9680-449b-a1eb-c42ea5401715] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:57.956108 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3130234e-8220-4139-a32b-75622955462d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041777 Aug 30 07:51:57.957010 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 401/759] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:51:57 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 07:51:57.961522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fde107ad-d2e9-4dd8-beb7-7ebc50981152 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:57.961973 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fde107ad-d2e9-4dd8-beb7-7ebc50981152 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:57.962776 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fde107ad-d2e9-4dd8-beb7-7ebc50981152 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:57.963207 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fde107ad-d2e9-4dd8-beb7-7ebc50981152 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:57.977361 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-fde107ad-d2e9-4dd8-beb7-7ebc50981152 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] HTTP exception thrown: Instance b32f1264-9680-449b-a1eb-c42ea5401715 could not be found. Aug 30 07:51:57.977947 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fde107ad-d2e9-4dd8-beb7-7ebc50981152 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Returning 404 to user: Instance b32f1264-9680-449b-a1eb-c42ea5401715 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:51:57.978808 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fde107ad-d2e9-4dd8-beb7-7ebc50981152 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715" status: 404 len: 111 microversion: 2.1 time: 0.029782 Aug 30 07:51:57.979351 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 359/760] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:57 2021] GET /compute/v2.1/servers/b32f1264-9680-449b-a1eb-c42ea5401715 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:51:57.987207 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-acffcd56-6078-4566-8a73-33700ac3ebef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:57.987700 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-acffcd56-6078-4566-8a73-33700ac3ebef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:57.993278 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-acffcd56-6078-4566-8a73-33700ac3ebef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:57.993713 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-acffcd56-6078-4566-8a73-33700ac3ebef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:57.994491 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-acffcd56-6078-4566-8a73-33700ac3ebef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:57.994918 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-acffcd56-6078-4566-8a73-33700ac3ebef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:58.021550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-acffcd56-6078-4566-8a73-33700ac3ebef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:51:58.101491 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-acffcd56-6078-4566-8a73-33700ac3ebef tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 204 len: 0 microversion: 2.1 time: 0.117590 Aug 30 07:51:58.102070 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 402/761] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:51:57 2021] DELETE /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:51:58.110107 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-48cd84ab-f3e8-4c18-96fe-1a8fe9d26895 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:58.110870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-48cd84ab-f3e8-4c18-96fe-1a8fe9d26895 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:58.117313 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-48cd84ab-f3e8-4c18-96fe-1a8fe9d26895 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:58.117966 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-48cd84ab-f3e8-4c18-96fe-1a8fe9d26895 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:58.118772 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-48cd84ab-f3e8-4c18-96fe-1a8fe9d26895 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:58.119442 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-48cd84ab-f3e8-4c18-96fe-1a8fe9d26895 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:58.242812 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-48cd84ab-f3e8-4c18-96fe-1a8fe9d26895 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:58.250368 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-48cd84ab-f3e8-4c18-96fe-1a8fe9d26895 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1513 microversion: 2.1 time: 0.143841 Aug 30 07:51:58.251067 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 360/762] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:58 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:58.406550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5ea7b909-13d3-42b2-a5c6-c50aa4c1a610 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce70ca3a-d541-4f20-bb4a-03b93e215c3f", "device": "/dev/sdb"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:58.408220 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5ea7b909-13d3-42b2-a5c6-c50aa4c1a610 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:58.414413 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ea7b909-13d3-42b2-a5c6-c50aa4c1a610 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:58.414860 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ea7b909-13d3-42b2-a5c6-c50aa4c1a610 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:58.415626 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ea7b909-13d3-42b2-a5c6-c50aa4c1a610 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:58.416056 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ea7b909-13d3-42b2-a5c6-c50aa4c1a610 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:58.567501 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-18da3847-6d88-4a4c-bc36-88e8772e4c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:58.568565 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-18da3847-6d88-4a4c-bc36-88e8772e4c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:58.574850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18da3847-6d88-4a4c-bc36-88e8772e4c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:58.575367 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18da3847-6d88-4a4c-bc36-88e8772e4c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:58.576231 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18da3847-6d88-4a4c-bc36-88e8772e4c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:58.576759 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18da3847-6d88-4a4c-bc36-88e8772e4c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:58.654819 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5ea7b909-13d3-42b2-a5c6-c50aa4c1a610 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "POST /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252282 Aug 30 07:51:58.656002 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 403/763] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:51:58 2021] POST /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:51:58.659716 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-18da3847-6d88-4a4c-bc36-88e8772e4c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.096938 Aug 30 07:51:58.660501 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 361/764] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:58 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:58.662044 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7fc46e4b-75d5-4062-bb81-f4611298e1d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:58.664269 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7fc46e4b-75d5-4062-bb81-f4611298e1d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:58.671809 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7fc46e4b-75d5-4062-bb81-f4611298e1d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:58.672090 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7fc46e4b-75d5-4062-bb81-f4611298e1d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:58.672843 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7fc46e4b-75d5-4062-bb81-f4611298e1d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:58.673331 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7fc46e4b-75d5-4062-bb81-f4611298e1d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:58.750354 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7fc46e4b-75d5-4062-bb81-f4611298e1d0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.092331 Aug 30 07:51:58.751021 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 404/765] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:58 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:51:59.269359 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-880dbd07-6156-44cd-ae56-ea1f131600c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:51:59.270134 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-880dbd07-6156-44cd-ae56-ea1f131600c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:59.276637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-880dbd07-6156-44cd-ae56-ea1f131600c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:59.277082 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-880dbd07-6156-44cd-ae56-ea1f131600c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:59.277891 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-880dbd07-6156-44cd-ae56-ea1f131600c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:59.278350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-880dbd07-6156-44cd-ae56-ea1f131600c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:59.406706 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-880dbd07-6156-44cd-ae56-ea1f131600c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:51:59.414748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-880dbd07-6156-44cd-ae56-ea1f131600c8 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1513 microversion: 2.1 time: 0.149571 Aug 30 07:51:59.415309 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 362/766] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:51:59 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:51:59.672235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-76d8ce30-da7d-4803-b2e1-fa655f6619b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:59.673227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-76d8ce30-da7d-4803-b2e1-fa655f6619b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:59.679785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-76d8ce30-da7d-4803-b2e1-fa655f6619b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:59.680226 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-76d8ce30-da7d-4803-b2e1-fa655f6619b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:59.681013 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-76d8ce30-da7d-4803-b2e1-fa655f6619b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:59.681439 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-76d8ce30-da7d-4803-b2e1-fa655f6619b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:59.762637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-957cd323-e402-4003-98e0-b29e81760426 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:51:59.763658 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-957cd323-e402-4003-98e0-b29e81760426 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:51:59.770583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-957cd323-e402-4003-98e0-b29e81760426 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:59.771044 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-957cd323-e402-4003-98e0-b29e81760426 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:59.771815 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-957cd323-e402-4003-98e0-b29e81760426 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:51:59.772244 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-957cd323-e402-4003-98e0-b29e81760426 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:51:59.781539 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-76d8ce30-da7d-4803-b2e1-fa655f6619b0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.113162 Aug 30 07:51:59.783151 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 405/767] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:51:59 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:51:59.847353 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-957cd323-e402-4003-98e0-b29e81760426 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.088287 Aug 30 07:51:59.848242 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 363/768] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:51:59 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:52:00.299940 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9b20d3c3-bb01-40f2-b828-02fb5cc5ae90 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:00.300580 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9b20d3c3-bb01-40f2-b828-02fb5cc5ae90 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:00.306996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b20d3c3-bb01-40f2-b828-02fb5cc5ae90 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:00.307438 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b20d3c3-bb01-40f2-b828-02fb5cc5ae90 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:00.308207 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b20d3c3-bb01-40f2-b828-02fb5cc5ae90 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:00.308644 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9b20d3c3-bb01-40f2-b828-02fb5cc5ae90 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:00.333444 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9b20d3c3-bb01-40f2-b828-02fb5cc5ae90 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:52:00.412578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9b20d3c3-bb01-40f2-b828-02fb5cc5ae90 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 204 len: 0 microversion: 2.1 time: 0.117166 Aug 30 07:52:00.413497 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 406/769] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:52:00 2021] DELETE /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:52:00.423021 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b3acbf00-fc98-4e0d-b9ce-463aa5591a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:00.423766 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b3acbf00-fc98-4e0d-b9ce-463aa5591a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:00.429989 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b3acbf00-fc98-4e0d-b9ce-463aa5591a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:00.430744 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b3acbf00-fc98-4e0d-b9ce-463aa5591a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:00.431712 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b3acbf00-fc98-4e0d-b9ce-463aa5591a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:00.432334 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b3acbf00-fc98-4e0d-b9ce-463aa5591a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:00.433294 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-56889eca-2959-405b-bc2a-370cb3fee72b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:00.434012 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-56889eca-2959-405b-bc2a-370cb3fee72b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:00.440634 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-56889eca-2959-405b-bc2a-370cb3fee72b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:00.441087 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-56889eca-2959-405b-bc2a-370cb3fee72b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:00.441872 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-56889eca-2959-405b-bc2a-370cb3fee72b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:00.442340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-56889eca-2959-405b-bc2a-370cb3fee72b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:00.565901 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-56889eca-2959-405b-bc2a-370cb3fee72b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:00.585312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-56889eca-2959-405b-bc2a-370cb3fee72b tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 200 len: 1513 microversion: 2.1 time: 0.155884 Aug 30 07:52:00.586289 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 407/770] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:00 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:00.631262 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b3acbf00-fc98-4e0d-b9ce-463aa5591a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:00.638765 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b3acbf00-fc98-4e0d-b9ce-463aa5591a2a tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1508 microversion: 2.1 time: 0.219623 Aug 30 07:52:00.639434 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 364/771] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:00 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:00.768073 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-2edfa3b7-55ed-4ea9-9d90-d842373cd101 req-02258dc2-f292-4bc7-81c5-13be7f670ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb", "name": "network-vif-deleted", "tag": "68f1f892-73b9-4984-bfa6-c10491ed1939"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:00.770722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:52:00.770722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:52:00.793425 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-79334d28-aa9a-4023-b4a6-1117f6a1e930 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:00.794380 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-79334d28-aa9a-4023-b4a6-1117f6a1e930 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:00.794981 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-2edfa3b7-55ed-4ea9-9d90-d842373cd101 req-02258dc2-f292-4bc7-81c5-13be7f670ce4 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:00.795588 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-2edfa3b7-55ed-4ea9-9d90-d842373cd101 req-02258dc2-f292-4bc7-81c5-13be7f670ce4 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:00.803998 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79334d28-aa9a-4023-b4a6-1117f6a1e930 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:00.804653 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79334d28-aa9a-4023-b4a6-1117f6a1e930 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:00.805824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79334d28-aa9a-4023-b4a6-1117f6a1e930 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:00.806466 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-79334d28-aa9a-4023-b4a6-1117f6a1e930 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:00.815837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-2edfa3b7-55ed-4ea9-9d90-d842373cd101 req-02258dc2-f292-4bc7-81c5-13be7f670ce4 service nova] Creating event network-vif-deleted:68f1f892-73b9-4984-bfa6-c10491ed1939 for instance 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb on hv-cinder-80619 Aug 30 07:52:00.845018 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-2edfa3b7-55ed-4ea9-9d90-d842373cd101 req-02258dc2-f292-4bc7-81c5-13be7f670ce4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081377 Aug 30 07:52:00.845779 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 408/772] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:52:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:00.862344 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6a3087cc-0943-4138-8cab-4bc3393f7cb3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:00.863386 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6a3087cc-0943-4138-8cab-4bc3393f7cb3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:00.869874 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a3087cc-0943-4138-8cab-4bc3393f7cb3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:00.870427 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a3087cc-0943-4138-8cab-4bc3393f7cb3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:00.871219 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a3087cc-0943-4138-8cab-4bc3393f7cb3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:00.871672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6a3087cc-0943-4138-8cab-4bc3393f7cb3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:00.903906 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-79334d28-aa9a-4023-b4a6-1117f6a1e930 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.114330 Aug 30 07:52:00.904917 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 365/773] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:00 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:00.962654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6a3087cc-0943-4138-8cab-4bc3393f7cb3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.105877 Aug 30 07:52:00.963295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 409/774] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:00 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:52:01.602884 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7e6f8ef7-4dde-46d2-ae88-0e0a7e759ef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:01.603613 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7e6f8ef7-4dde-46d2-ae88-0e0a7e759ef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:01.610094 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e6f8ef7-4dde-46d2-ae88-0e0a7e759ef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:01.610575 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e6f8ef7-4dde-46d2-ae88-0e0a7e759ef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:01.611438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e6f8ef7-4dde-46d2-ae88-0e0a7e759ef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:01.612023 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e6f8ef7-4dde-46d2-ae88-0e0a7e759ef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:01.625201 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-7e6f8ef7-4dde-46d2-ae88-0e0a7e759ef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] HTTP exception thrown: Instance 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb could not be found. Aug 30 07:52:01.625814 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7e6f8ef7-4dde-46d2-ae88-0e0a7e759ef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Returning 404 to user: Instance 6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:52:01.626724 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7e6f8ef7-4dde-46d2-ae88-0e0a7e759ef5 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb" status: 404 len: 111 microversion: 2.1 time: 0.027876 Aug 30 07:52:01.627394 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 366/775] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:01 2021] GET /compute/v2.1/servers/6bd1febe-2f65-4cd3-a6e1-55afe4c4b2eb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:52:01.656975 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d1f6751d-8a2a-4460-b0f3-f500dd522c32 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:01.657676 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d1f6751d-8a2a-4460-b0f3-f500dd522c32 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:01.665162 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d1f6751d-8a2a-4460-b0f3-f500dd522c32 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:01.665609 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d1f6751d-8a2a-4460-b0f3-f500dd522c32 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:01.666418 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d1f6751d-8a2a-4460-b0f3-f500dd522c32 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:01.666848 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d1f6751d-8a2a-4460-b0f3-f500dd522c32 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:01.798183 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d1f6751d-8a2a-4460-b0f3-f500dd522c32 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:01.806131 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d1f6751d-8a2a-4460-b0f3-f500dd522c32 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1508 microversion: 2.1 time: 0.153028 Aug 30 07:52:01.806718 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 410/776] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:01 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:01.915316 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a8652744-d7db-452d-8213-8cbce21e6d61 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:01.916235 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a8652744-d7db-452d-8213-8cbce21e6d61 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:01.921937 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a8652744-d7db-452d-8213-8cbce21e6d61 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:01.922420 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a8652744-d7db-452d-8213-8cbce21e6d61 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:01.923180 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a8652744-d7db-452d-8213-8cbce21e6d61 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:01.923641 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a8652744-d7db-452d-8213-8cbce21e6d61 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:01.974598 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d0768d31-a253-40bb-af74-00c226440aec tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:01.975569 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d0768d31-a253-40bb-af74-00c226440aec tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:01.981206 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d0768d31-a253-40bb-af74-00c226440aec tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:01.981653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d0768d31-a253-40bb-af74-00c226440aec tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:01.982450 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d0768d31-a253-40bb-af74-00c226440aec tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:01.982887 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d0768d31-a253-40bb-af74-00c226440aec tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:01.997631 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a8652744-d7db-452d-8213-8cbce21e6d61 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.085751 Aug 30 07:52:02.002244 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 367/777] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:01 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:02.047708 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d0768d31-a253-40bb-af74-00c226440aec tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.076646 Aug 30 07:52:02.048343 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 411/778] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:01 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:52:02.761690 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f2377311-5ecd-4de6-a379-9a9c7942f106 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:02.762311 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f2377311-5ecd-4de6-a379-9a9c7942f106 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:02.768870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2377311-5ecd-4de6-a379-9a9c7942f106 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:02.769319 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2377311-5ecd-4de6-a379-9a9c7942f106 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:02.770078 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2377311-5ecd-4de6-a379-9a9c7942f106 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:02.770537 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2377311-5ecd-4de6-a379-9a9c7942f106 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:02.794530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f2377311-5ecd-4de6-a379-9a9c7942f106 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Going to try to terminate instance {{(pid=114670) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:52:02.823262 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7b5f017a-db16-4489-b851-aa63dd21bc7c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:02.823964 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7b5f017a-db16-4489-b851-aa63dd21bc7c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:02.831704 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b5f017a-db16-4489-b851-aa63dd21bc7c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:02.832256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b5f017a-db16-4489-b851-aa63dd21bc7c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:02.833276 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b5f017a-db16-4489-b851-aa63dd21bc7c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:02.833709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b5f017a-db16-4489-b851-aa63dd21bc7c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:02.871429 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f2377311-5ecd-4de6-a379-9a9c7942f106 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 204 len: 0 microversion: 2.1 time: 0.113290 Aug 30 07:52:02.872763 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 368/779] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:52:02 2021] DELETE /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:52:02.881629 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9acac21b-8c19-4586-a0bf-000a53fd50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:02.882373 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9acac21b-8c19-4586-a0bf-000a53fd50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:02.888447 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9acac21b-8c19-4586-a0bf-000a53fd50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:02.888899 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9acac21b-8c19-4586-a0bf-000a53fd50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:02.889663 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9acac21b-8c19-4586-a0bf-000a53fd50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:02.890098 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9acac21b-8c19-4586-a0bf-000a53fd50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:02.961272 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7b5f017a-db16-4489-b851-aa63dd21bc7c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:02.970100 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7b5f017a-db16-4489-b851-aa63dd21bc7c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1508 microversion: 2.1 time: 0.150771 Aug 30 07:52:02.970804 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 412/780] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:02 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:03.009783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7f6012c7-33cc-4bba-8989-b729113590ac tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:03.010677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7f6012c7-33cc-4bba-8989-b729113590ac tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:03.016406 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f6012c7-33cc-4bba-8989-b729113590ac tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:03.016848 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f6012c7-33cc-4bba-8989-b729113590ac tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:03.017605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f6012c7-33cc-4bba-8989-b729113590ac tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:03.018680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f6012c7-33cc-4bba-8989-b729113590ac tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:03.030629 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9acac21b-8c19-4586-a0bf-000a53fd50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:03.038718 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9acac21b-8c19-4586-a0bf-000a53fd50bb tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1514 microversion: 2.1 time: 0.161819 Aug 30 07:52:03.039399 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 369/781] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:02 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:03.058994 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-890f9899-1e24-4495-9d77-c5a454381f2f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:03.059905 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-890f9899-1e24-4495-9d77-c5a454381f2f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:03.066003 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-890f9899-1e24-4495-9d77-c5a454381f2f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:03.066489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-890f9899-1e24-4495-9d77-c5a454381f2f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:03.067289 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-890f9899-1e24-4495-9d77-c5a454381f2f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:03.067727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-890f9899-1e24-4495-9d77-c5a454381f2f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:03.155177 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7f6012c7-33cc-4bba-8989-b729113590ac tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.149369 Aug 30 07:52:03.155826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 413/782] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:03 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:03.162094 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-890f9899-1e24-4495-9d77-c5a454381f2f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.106445 Aug 30 07:52:03.162844 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 370/783] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:03 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:52:03.955680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-26d9d101-fdf3-42db-82ce-a01fb63089e7 req-0d1c1a8c-f8be-4398-bd04-4e0dc452dfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab74e53e-3def-4d56-a5a3-9bdaae91e894", "name": "network-vif-deleted", "tag": "7df2dfe2-84f3-44d6-9b60-1cece886854d"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:03.957368 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:52:03.957368 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:52:03.981690 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-26d9d101-fdf3-42db-82ce-a01fb63089e7 req-0d1c1a8c-f8be-4398-bd04-4e0dc452dfe3 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:03.982661 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-26d9d101-fdf3-42db-82ce-a01fb63089e7 req-0d1c1a8c-f8be-4398-bd04-4e0dc452dfe3 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:03.989006 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9447fdcd-aff0-4d51-a1b8-796682ede2ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:03.989715 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9447fdcd-aff0-4d51-a1b8-796682ede2ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:03.997906 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9447fdcd-aff0-4d51-a1b8-796682ede2ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:03.998821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9447fdcd-aff0-4d51-a1b8-796682ede2ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:03.999770 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9447fdcd-aff0-4d51-a1b8-796682ede2ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:04.000372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9447fdcd-aff0-4d51-a1b8-796682ede2ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:04.005295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-26d9d101-fdf3-42db-82ce-a01fb63089e7 req-0d1c1a8c-f8be-4398-bd04-4e0dc452dfe3 service nova] Creating event network-vif-deleted:7df2dfe2-84f3-44d6-9b60-1cece886854d for instance ab74e53e-3def-4d56-a5a3-9bdaae91e894 on hv-cinder-80619 Aug 30 07:52:04.016297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-26d9d101-fdf3-42db-82ce-a01fb63089e7 req-0d1c1a8c-f8be-4398-bd04-4e0dc452dfe3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064677 Aug 30 07:52:04.021725 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 414/784] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:52:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:04.057143 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-37af995f-d385-465d-8b21-f2ab406c61a9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:04.057963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-37af995f-d385-465d-8b21-f2ab406c61a9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:04.068642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37af995f-d385-465d-8b21-f2ab406c61a9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:04.069193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37af995f-d385-465d-8b21-f2ab406c61a9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:04.070060 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37af995f-d385-465d-8b21-f2ab406c61a9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:04.078755 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37af995f-d385-465d-8b21-f2ab406c61a9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:04.093127 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9447fdcd-aff0-4d51-a1b8-796682ede2ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:04.100738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9447fdcd-aff0-4d51-a1b8-796682ede2ab tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 200 len: 1292 microversion: 2.1 time: 0.116729 Aug 30 07:52:04.101308 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 371/785] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:03 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 1292 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:04.167280 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e9c1247f-5b6f-4fe0-b9fc-3da732d872a0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:04.168586 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e9c1247f-5b6f-4fe0-b9fc-3da732d872a0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:04.174825 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e9c1247f-5b6f-4fe0-b9fc-3da732d872a0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:04.175606 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e9c1247f-5b6f-4fe0-b9fc-3da732d872a0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:04.176981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e9c1247f-5b6f-4fe0-b9fc-3da732d872a0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:04.176981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e9c1247f-5b6f-4fe0-b9fc-3da732d872a0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:04.207909 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-37af995f-d385-465d-8b21-f2ab406c61a9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:04.215212 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-37af995f-d385-465d-8b21-f2ab406c61a9 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1514 microversion: 2.1 time: 0.162346 Aug 30 07:52:04.215770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 415/786] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:04 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:04.220035 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a4c475e1-1c9e-4ff0-8a4f-91f416e9d1a4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:04.220873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a4c475e1-1c9e-4ff0-8a4f-91f416e9d1a4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:04.227068 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a4c475e1-1c9e-4ff0-8a4f-91f416e9d1a4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:04.227506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a4c475e1-1c9e-4ff0-8a4f-91f416e9d1a4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:04.228261 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a4c475e1-1c9e-4ff0-8a4f-91f416e9d1a4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:04.228691 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a4c475e1-1c9e-4ff0-8a4f-91f416e9d1a4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:04.248308 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e9c1247f-5b6f-4fe0-b9fc-3da732d872a0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.084284 Aug 30 07:52:04.256727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 372/787] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:04 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:04.395869 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a4c475e1-1c9e-4ff0-8a4f-91f416e9d1a4 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.178835 Aug 30 07:52:04.396510 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 416/788] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:04 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:52:05.117163 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1b996ae1-9348-4764-9055-5af3b0d426eb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:05.118121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1b996ae1-9348-4764-9055-5af3b0d426eb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: ab74e53e-3def-4d56-a5a3-9bdaae91e894] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:05.124901 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b996ae1-9348-4764-9055-5af3b0d426eb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.125350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b996ae1-9348-4764-9055-5af3b0d426eb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.126127 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b996ae1-9348-4764-9055-5af3b0d426eb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.126775 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b996ae1-9348-4764-9055-5af3b0d426eb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.141512 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-1b996ae1-9348-4764-9055-5af3b0d426eb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] HTTP exception thrown: Instance ab74e53e-3def-4d56-a5a3-9bdaae91e894 could not be found. Aug 30 07:52:05.142119 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1b996ae1-9348-4764-9055-5af3b0d426eb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Returning 404 to user: Instance ab74e53e-3def-4d56-a5a3-9bdaae91e894 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:52:05.143675 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1b996ae1-9348-4764-9055-5af3b0d426eb tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894" status: 404 len: 111 microversion: 2.1 time: 0.029946 Aug 30 07:52:05.144224 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 373/789] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:05 2021] GET /compute/v2.1/servers/ab74e53e-3def-4d56-a5a3-9bdaae91e894 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:52:05.152771 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d4168f43-275e-4323-b8ae-b01d3a90de9e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:05.153503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d4168f43-275e-4323-b8ae-b01d3a90de9e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:05.159730 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4168f43-275e-4323-b8ae-b01d3a90de9e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.160181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4168f43-275e-4323-b8ae-b01d3a90de9e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.160966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4168f43-275e-4323-b8ae-b01d3a90de9e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.161400 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4168f43-275e-4323-b8ae-b01d3a90de9e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.187386 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d4168f43-275e-4323-b8ae-b01d3a90de9e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:52:05.232215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5614e961-02db-4838-8fe7-a6a8f84d2896 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:05.233132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5614e961-02db-4838-8fe7-a6a8f84d2896 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:05.239255 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5614e961-02db-4838-8fe7-a6a8f84d2896 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.239907 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5614e961-02db-4838-8fe7-a6a8f84d2896 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.240881 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5614e961-02db-4838-8fe7-a6a8f84d2896 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.241574 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5614e961-02db-4838-8fe7-a6a8f84d2896 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.284224 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d4168f43-275e-4323-b8ae-b01d3a90de9e tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "DELETE /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 204 len: 0 microversion: 2.1 time: 0.134823 Aug 30 07:52:05.284818 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 417/790] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:52:05 2021] DELETE /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:52:05.291408 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-427adad1-bca7-49aa-aef8-e17cbee801ed tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:05.292421 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-427adad1-bca7-49aa-aef8-e17cbee801ed tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:05.300178 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-427adad1-bca7-49aa-aef8-e17cbee801ed tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.301067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-427adad1-bca7-49aa-aef8-e17cbee801ed tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.302039 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-427adad1-bca7-49aa-aef8-e17cbee801ed tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.302512 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-427adad1-bca7-49aa-aef8-e17cbee801ed tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.384106 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-427adad1-bca7-49aa-aef8-e17cbee801ed tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.097871 Aug 30 07:52:05.385163 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 418/791] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:05 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:05.390971 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-596b6416-8c7f-4174-8dad-58f690d8f835 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:05.391680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-596b6416-8c7f-4174-8dad-58f690d8f835 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:05.399642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-596b6416-8c7f-4174-8dad-58f690d8f835 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.400091 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-596b6416-8c7f-4174-8dad-58f690d8f835 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.401275 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-596b6416-8c7f-4174-8dad-58f690d8f835 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.401396 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-596b6416-8c7f-4174-8dad-58f690d8f835 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.458491 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5614e961-02db-4838-8fe7-a6a8f84d2896 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93170b4e61c9470ba9b7ec6bb66e86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7540de7f257475e864b4023460d355a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:05.465984 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5614e961-02db-4838-8fe7-a6a8f84d2896 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 200 len: 1514 microversion: 2.1 time: 0.237350 Aug 30 07:52:05.470467 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 374/792] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:05 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:05.475316 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9b6947c8-8bd4-45d2-b15c-51463978c928 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:05.479230 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9b6947c8-8bd4-45d2-b15c-51463978c928 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:05.486094 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b6947c8-8bd4-45d2-b15c-51463978c928 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.491305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b6947c8-8bd4-45d2-b15c-51463978c928 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.493445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b6947c8-8bd4-45d2-b15c-51463978c928 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:05.495228 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b6947c8-8bd4-45d2-b15c-51463978c928 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:05.542455 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-596b6416-8c7f-4174-8dad-58f690d8f835 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:05.550523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-596b6416-8c7f-4174-8dad-58f690d8f835 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.163966 Aug 30 07:52:05.551104 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 419/793] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:05 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:05.579717 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9b6947c8-8bd4-45d2-b15c-51463978c928 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 28624 microversion: 2.1 time: 0.107369 Aug 30 07:52:05.580548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 375/794] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:05 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 28624 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:52:06.036983 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-b10c9249-6483-4f3d-a10c-ab98474f459b req-bcd5d3f2-449c-47d4-b7ad-09de0e00c25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4967d79f-d77e-494e-913b-b11b09a5dee4", "name": "network-vif-deleted", "tag": "6775eff3-812a-4ed1-8de8-36fd5d098c28"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:06.038518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:52:06.038518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:52:06.045250 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-b10c9249-6483-4f3d-a10c-ab98474f459b req-bcd5d3f2-449c-47d4-b7ad-09de0e00c25b service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:06.045688 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-b10c9249-6483-4f3d-a10c-ab98474f459b req-bcd5d3f2-449c-47d4-b7ad-09de0e00c25b service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:06.056300 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-b10c9249-6483-4f3d-a10c-ab98474f459b req-bcd5d3f2-449c-47d4-b7ad-09de0e00c25b service nova] Creating event network-vif-deleted:6775eff3-812a-4ed1-8de8-36fd5d098c28 for instance 4967d79f-d77e-494e-913b-b11b09a5dee4 on hv-cinder-80619 Aug 30 07:52:06.060971 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-b10c9249-6483-4f3d-a10c-ab98474f459b req-bcd5d3f2-449c-47d4-b7ad-09de0e00c25b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028204 Aug 30 07:52:06.061479 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 420/795] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:52:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:06.397803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-eb6e052a-aec4-41ec-8f15-864d69c8cd79 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:06.398826 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-eb6e052a-aec4-41ec-8f15-864d69c8cd79 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:06.405110 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb6e052a-aec4-41ec-8f15-864d69c8cd79 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:06.405559 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb6e052a-aec4-41ec-8f15-864d69c8cd79 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:06.406630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb6e052a-aec4-41ec-8f15-864d69c8cd79 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:06.407058 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb6e052a-aec4-41ec-8f15-864d69c8cd79 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:06.481798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-eb6e052a-aec4-41ec-8f15-864d69c8cd79 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.088896 Aug 30 07:52:06.483016 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 376/796] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:06 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:06.487966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-017cc5ae-cfea-44c4-9882-f5c8e3068562 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:06.488671 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-017cc5ae-cfea-44c4-9882-f5c8e3068562 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] [instance: 4967d79f-d77e-494e-913b-b11b09a5dee4] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:06.494666 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-017cc5ae-cfea-44c4-9882-f5c8e3068562 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:06.495111 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-017cc5ae-cfea-44c4-9882-f5c8e3068562 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:06.495876 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-017cc5ae-cfea-44c4-9882-f5c8e3068562 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:06.496311 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-017cc5ae-cfea-44c4-9882-f5c8e3068562 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:06.509873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-017cc5ae-cfea-44c4-9882-f5c8e3068562 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] HTTP exception thrown: Instance 4967d79f-d77e-494e-913b-b11b09a5dee4 could not be found. Aug 30 07:52:06.510481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-017cc5ae-cfea-44c4-9882-f5c8e3068562 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] Returning 404 to user: Instance 4967d79f-d77e-494e-913b-b11b09a5dee4 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:52:06.511308 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-017cc5ae-cfea-44c4-9882-f5c8e3068562 tempest-AttachVolumeNegativeTest-486867577 tempest-AttachVolumeNegativeTest-486867577-project] 10.222.0.73 "GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4" status: 404 len: 111 microversion: 2.1 time: 0.027977 Aug 30 07:52:06.511826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 421/797] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:06 2021] GET /compute/v2.1/servers/4967d79f-d77e-494e-913b-b11b09a5dee4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:52:06.568560 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b8187247-a2a2-419a-9dce-3b8b98268d9c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:06.569336 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b8187247-a2a2-419a-9dce-3b8b98268d9c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:06.575824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8187247-a2a2-419a-9dce-3b8b98268d9c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:06.576264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8187247-a2a2-419a-9dce-3b8b98268d9c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:06.577023 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8187247-a2a2-419a-9dce-3b8b98268d9c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:06.577453 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8187247-a2a2-419a-9dce-3b8b98268d9c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:06.593054 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bd1164e4-6675-4d0c-8790-a0cf0d79b537 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:06.593972 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bd1164e4-6675-4d0c-8790-a0cf0d79b537 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:06.601297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bd1164e4-6675-4d0c-8790-a0cf0d79b537 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:06.601773 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bd1164e4-6675-4d0c-8790-a0cf0d79b537 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:06.602794 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bd1164e4-6675-4d0c-8790-a0cf0d79b537 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:06.603398 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bd1164e4-6675-4d0c-8790-a0cf0d79b537 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:06.688212 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bd1164e4-6675-4d0c-8790-a0cf0d79b537 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 29786 microversion: 2.1 time: 0.098762 Aug 30 07:52:06.692296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 422/798] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:06 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 29786 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:52:06.786105 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b8187247-a2a2-419a-9dce-3b8b98268d9c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:06.796740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b8187247-a2a2-419a-9dce-3b8b98268d9c tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.232908 Aug 30 07:52:06.797318 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 377/799] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:06 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:07.494872 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8497adbc-1266-4dd5-afbc-6f4102caf8e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:07.495926 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8497adbc-1266-4dd5-afbc-6f4102caf8e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:07.503220 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8497adbc-1266-4dd5-afbc-6f4102caf8e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:07.503671 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8497adbc-1266-4dd5-afbc-6f4102caf8e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:07.504436 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8497adbc-1266-4dd5-afbc-6f4102caf8e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:07.504862 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8497adbc-1266-4dd5-afbc-6f4102caf8e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:07.577685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8497adbc-1266-4dd5-afbc-6f4102caf8e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.087505 Aug 30 07:52:07.578509 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 423/800] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:07 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:07.701112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-446c2ef1-1eca-43ef-987e-4926720c0597 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:07.701112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-446c2ef1-1eca-43ef-987e-4926720c0597 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:07.707782 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-446c2ef1-1eca-43ef-987e-4926720c0597 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:07.708223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-446c2ef1-1eca-43ef-987e-4926720c0597 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:07.708985 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-446c2ef1-1eca-43ef-987e-4926720c0597 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:07.709417 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-446c2ef1-1eca-43ef-987e-4926720c0597 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:07.813087 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c4bade5b-e76e-43a5-8b3b-a583122c2373 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:07.813834 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c4bade5b-e76e-43a5-8b3b-a583122c2373 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:07.820592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c4bade5b-e76e-43a5-8b3b-a583122c2373 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:07.821041 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c4bade5b-e76e-43a5-8b3b-a583122c2373 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:07.821898 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c4bade5b-e76e-43a5-8b3b-a583122c2373 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:07.822260 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c4bade5b-e76e-43a5-8b3b-a583122c2373 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:07.948181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c4bade5b-e76e-43a5-8b3b-a583122c2373 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:07.956488 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c4bade5b-e76e-43a5-8b3b-a583122c2373 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.146859 Aug 30 07:52:07.957266 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 424/801] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:07 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:08.207693 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ae5e4894-7e86-4d1a-8f37-0b13ed1082aa tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Action: 'create', calling method: .version_select at 0x7f341c288ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-833487514"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:08.496934 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ae5e4894-7e86-4d1a-8f37-0b13ed1082aa tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.419714 Aug 30 07:52:08.497542 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 425/802] 10.222.0.73 () {60 vars in 1155 bytes} [Mon Aug 30 07:52:08 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 421 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 30 07:52:08.508999 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3f75e0bc-db79-42fa-8ed6-7d7a5a6624e6 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c25ce50>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:08.560625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3f75e0bc-db79-42fa-8ed6-7d7a5a6624e6 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0" status: 200 len: 344 microversion: 2.1 time: 0.055589 Aug 30 07:52:08.561193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 426/803] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:52:08 2021] GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:52:08.589443 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5d64d7b7-84e4-4a52-9f22-24518456dc02 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:08.590378 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5d64d7b7-84e4-4a52-9f22-24518456dc02 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:08.597244 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d64d7b7-84e4-4a52-9f22-24518456dc02 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:08.597687 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d64d7b7-84e4-4a52-9f22-24518456dc02 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:08.598477 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d64d7b7-84e4-4a52-9f22-24518456dc02 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:08.598922 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d64d7b7-84e4-4a52-9f22-24518456dc02 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:09.790943 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-446c2ef1-1eca-43ef-987e-4926720c0597 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 33250 microversion: 2.1 time: 2.094425 Aug 30 07:52:09.795305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 378/804] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:07 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 33250 bytes in 2096 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:52:09.796715 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5d64d7b7-84e4-4a52-9f22-24518456dc02 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 1.210627 Aug 30 07:52:09.797181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1eac403d-fac0-4082-bb38-6da1ffabeac1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:09.801993 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 427/805] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:08 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:09.802253 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1eac403d-fac0-4082-bb38-6da1ffabeac1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:09.802948 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cd94da6f-6477-4961-8268-8634322415d2 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c137ca0>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:09.806293 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1eac403d-fac0-4082-bb38-6da1ffabeac1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:09.806753 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1eac403d-fac0-4082-bb38-6da1ffabeac1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:09.807563 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1eac403d-fac0-4082-bb38-6da1ffabeac1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:09.808048 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1eac403d-fac0-4082-bb38-6da1ffabeac1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:09.854276 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cd94da6f-6477-4961-8268-8634322415d2 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0" status: 200 len: 344 microversion: 2.1 time: 0.055669 Aug 30 07:52:09.854847 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 428/806] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:52:09 2021] GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:09.930840 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1eac403d-fac0-4082-bb38-6da1ffabeac1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:09.938163 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1eac403d-fac0-4082-bb38-6da1ffabeac1 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.145329 Aug 30 07:52:09.938734 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 379/807] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:09 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:10.803271 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f8f6d24f-feaa-4b40-84d1-0284fdd58024 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:10.804243 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f8f6d24f-feaa-4b40-84d1-0284fdd58024 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:10.809587 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-892f4a44-54ec-49ec-8484-3f4abf25d4fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:10.810538 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-892f4a44-54ec-49ec-8484-3f4abf25d4fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:10.811009 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f8f6d24f-feaa-4b40-84d1-0284fdd58024 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:10.811460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f8f6d24f-feaa-4b40-84d1-0284fdd58024 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:10.812234 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f8f6d24f-feaa-4b40-84d1-0284fdd58024 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:10.812666 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f8f6d24f-feaa-4b40-84d1-0284fdd58024 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:10.816842 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-892f4a44-54ec-49ec-8484-3f4abf25d4fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:10.817289 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-892f4a44-54ec-49ec-8484-3f4abf25d4fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:10.818046 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-892f4a44-54ec-49ec-8484-3f4abf25d4fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:10.818497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-892f4a44-54ec-49ec-8484-3f4abf25d4fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:11.481469 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f8f6d24f-feaa-4b40-84d1-0284fdd58024 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 34316 microversion: 2.1 time: 0.681840 Aug 30 07:52:11.485785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 429/808] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:10 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 34316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:52:11.485943 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-892f4a44-54ec-49ec-8484-3f4abf25d4fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.679072 Aug 30 07:52:11.486033 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 380/809] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:10 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:11.487573 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-baa90040-67b1-4337-8c80-bb94407a7b62 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c137af0>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:11.492259 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e4b518fe-8e7e-4e08-a5a9-2aa2af48eea2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:11.492952 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e4b518fe-8e7e-4e08-a5a9-2aa2af48eea2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:11.499685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4b518fe-8e7e-4e08-a5a9-2aa2af48eea2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:11.500128 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4b518fe-8e7e-4e08-a5a9-2aa2af48eea2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:11.500890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4b518fe-8e7e-4e08-a5a9-2aa2af48eea2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:11.501897 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e4b518fe-8e7e-4e08-a5a9-2aa2af48eea2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:11.543028 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-baa90040-67b1-4337-8c80-bb94407a7b62 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0" status: 200 len: 344 microversion: 2.1 time: 0.059696 Aug 30 07:52:11.543619 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 430/810] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:52:11 2021] GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:11.631817 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e4b518fe-8e7e-4e08-a5a9-2aa2af48eea2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:11.639055 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e4b518fe-8e7e-4e08-a5a9-2aa2af48eea2 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.151799 Aug 30 07:52:11.639608 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 381/811] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:11 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:12.493543 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b513a205-229a-46b6-9917-48c5fcede804 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:12.494615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b513a205-229a-46b6-9917-48c5fcede804 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:12.497922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4f93f162-16e8-4ec7-a009-a315b0c449de tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:12.498879 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4f93f162-16e8-4ec7-a009-a315b0c449de tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:12.501677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b513a205-229a-46b6-9917-48c5fcede804 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:12.502172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b513a205-229a-46b6-9917-48c5fcede804 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:12.502947 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b513a205-229a-46b6-9917-48c5fcede804 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:12.503386 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b513a205-229a-46b6-9917-48c5fcede804 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:12.505570 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f93f162-16e8-4ec7-a009-a315b0c449de tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:12.505874 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f93f162-16e8-4ec7-a009-a315b0c449de tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:12.506669 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f93f162-16e8-4ec7-a009-a315b0c449de tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:12.507087 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f93f162-16e8-4ec7-a009-a315b0c449de tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:12.605685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b513a205-229a-46b6-9917-48c5fcede804 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 35274 microversion: 2.1 time: 0.115458 Aug 30 07:52:12.608405 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4f93f162-16e8-4ec7-a009-a315b0c449de tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.114127 Aug 30 07:52:12.608608 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 431/812] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:12 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 35274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:52:12.609421 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 382/813] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:12 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:12.614283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-27f92768-1f35-455c-8c74-3b20b120fc4e tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341cac48b0>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:12.656318 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ac5a8a57-301e-4b9d-a9fd-ddc4edeefa5f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:12.657304 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ac5a8a57-301e-4b9d-a9fd-ddc4edeefa5f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:12.664454 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ac5a8a57-301e-4b9d-a9fd-ddc4edeefa5f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:12.664985 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ac5a8a57-301e-4b9d-a9fd-ddc4edeefa5f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:12.665861 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ac5a8a57-301e-4b9d-a9fd-ddc4edeefa5f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:12.666319 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ac5a8a57-301e-4b9d-a9fd-ddc4edeefa5f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:12.681642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-27f92768-1f35-455c-8c74-3b20b120fc4e tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0" status: 200 len: 345 microversion: 2.1 time: 0.071221 Aug 30 07:52:12.689133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 432/814] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:52:12 2021] GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:12.695777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bc511175-69b9-4405-bfd0-77542706e308 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Action: 'create', calling method: .version_select at 0x7f341c137c10>, body: {"snapshot": {"volume_id": "16199fe9-9ff5-4724-88fa-86d6e4222ea0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-835262649"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:12.822454 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ac5a8a57-301e-4b9d-a9fd-ddc4edeefa5f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:12.831559 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ac5a8a57-301e-4b9d-a9fd-ddc4edeefa5f tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.179441 Aug 30 07:52:12.832227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 383/815] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:12 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:12.846286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bc511175-69b9-4405-bfd0-77542706e308 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.156408 Aug 30 07:52:12.846868 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 433/816] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Aug 30 07:52:12 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:12.856743 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b2a9cbe9-4866-4cd0-b028-4dd067d83a96 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c1a4160>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:12.888137 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b2a9cbe9-4866-4cd0-b028-4dd067d83a96 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 200 len: 286 microversion: 2.1 time: 0.034905 Aug 30 07:52:12.888694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 384/817] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:12 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:12.898084 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-658fcc56-9666-4430-aaa6-9a970b094603 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c1ac4c0>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:12.937911 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-658fcc56-9666-4430-aaa6-9a970b094603 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.043373 Aug 30 07:52:12.938513 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 434/818] 10.222.0.73 () {58 vars in 1140 bytes} [Mon Aug 30 07:52:12 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:12.948936 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-663dfa6d-a0ba-4c77-878d-dc66874320d7 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c14ca60>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:12.977830 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-663dfa6d-a0ba-4c77-878d-dc66874320d7 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 200 len: 286 microversion: 2.1 time: 0.032399 Aug 30 07:52:12.978539 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 385/819] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:12 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:13.618390 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8be84cf1-929e-4db1-abc7-1c4e0a6ee05a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:13.620199 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8be84cf1-929e-4db1-abc7-1c4e0a6ee05a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:13.620492 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cf0ba382-6f05-4062-862f-ff0db6c60c36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:13.621655 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-cf0ba382-6f05-4062-862f-ff0db6c60c36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:13.627429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8be84cf1-929e-4db1-abc7-1c4e0a6ee05a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:13.627742 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cf0ba382-6f05-4062-862f-ff0db6c60c36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:13.627881 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8be84cf1-929e-4db1-abc7-1c4e0a6ee05a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:13.628183 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cf0ba382-6f05-4062-862f-ff0db6c60c36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:13.628697 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8be84cf1-929e-4db1-abc7-1c4e0a6ee05a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:13.628940 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cf0ba382-6f05-4062-862f-ff0db6c60c36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:13.629132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8be84cf1-929e-4db1-abc7-1c4e0a6ee05a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:13.629364 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cf0ba382-6f05-4062-862f-ff0db6c60c36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:17.035925 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-cf0ba382-6f05-4062-862f-ff0db6c60c36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 3.418913 Aug 30 07:52:17.040003 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 386/820] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:13 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 3420 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:17.041721 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-aa79b211-7734-43c8-b958-476ef2201c87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:17.042513 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-aa79b211-7734-43c8-b958-476ef2201c87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:17.048951 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa79b211-7734-43c8-b958-476ef2201c87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:17.049341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa79b211-7734-43c8-b958-476ef2201c87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:17.050101 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa79b211-7734-43c8-b958-476ef2201c87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:17.050559 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aa79b211-7734-43c8-b958-476ef2201c87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:17.076766 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8be84cf1-929e-4db1-abc7-1c4e0a6ee05a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 38082 microversion: 2.1 time: 3.461962 Aug 30 07:52:17.077804 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 435/821] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:13 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 38082 bytes in 3464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:52:17.085429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b35c49a6-1ea7-4310-9fa4-b285520c7fb0 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c1fbe50>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:17.114087 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b35c49a6-1ea7-4310-9fa4-b285520c7fb0 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 200 len: 286 microversion: 2.1 time: 0.034970 Aug 30 07:52:17.114686 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 436/822] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:17 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:17.173348 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-aa79b211-7734-43c8-b958-476ef2201c87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:17.181821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-aa79b211-7734-43c8-b958-476ef2201c87 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.143818 Aug 30 07:52:17.182415 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 387/823] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:17 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:18.047016 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0af5db4d-1bd4-4060-8057-f195216c86f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:18.048084 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0af5db4d-1bd4-4060-8057-f195216c86f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:18.054951 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0af5db4d-1bd4-4060-8057-f195216c86f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:18.055396 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0af5db4d-1bd4-4060-8057-f195216c86f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:18.056170 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0af5db4d-1bd4-4060-8057-f195216c86f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:18.056602 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0af5db4d-1bd4-4060-8057-f195216c86f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:18.089189 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f5c21a50-0a78-4ee9-afb8-8e830411f257 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:18.090108 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f5c21a50-0a78-4ee9-afb8-8e830411f257 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:18.096350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5c21a50-0a78-4ee9-afb8-8e830411f257 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:18.096802 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5c21a50-0a78-4ee9-afb8-8e830411f257 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:18.097568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5c21a50-0a78-4ee9-afb8-8e830411f257 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:18.098003 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5c21a50-0a78-4ee9-afb8-8e830411f257 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:18.172668 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0af5db4d-1bd4-4060-8057-f195216c86f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.129264 Aug 30 07:52:18.173729 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 437/824] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:18 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:18.178608 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f6f1ec9b-1485-42da-a43d-0f602211d494 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c20ee50>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:18.207300 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f6f1ec9b-1485-42da-a43d-0f602211d494 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 200 len: 286 microversion: 2.1 time: 0.032349 Aug 30 07:52:18.207863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 438/825] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:18 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:18.212941 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-eabc213b-65c8-4960-8013-1fd490231b62 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:18.213658 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-eabc213b-65c8-4960-8013-1fd490231b62 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:18.219778 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eabc213b-65c8-4960-8013-1fd490231b62 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:18.220224 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eabc213b-65c8-4960-8013-1fd490231b62 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:18.220984 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eabc213b-65c8-4960-8013-1fd490231b62 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:18.221420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-eabc213b-65c8-4960-8013-1fd490231b62 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:18.345562 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-eabc213b-65c8-4960-8013-1fd490231b62 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:18.353172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-eabc213b-65c8-4960-8013-1fd490231b62 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.144264 Aug 30 07:52:18.353734 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 439/826] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:18 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:19.185266 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b0814fd4-06ba-403b-bd54-4c013ab0e900 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:19.186133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b0814fd4-06ba-403b-bd54-4c013ab0e900 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:19.192317 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0814fd4-06ba-403b-bd54-4c013ab0e900 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:19.192767 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0814fd4-06ba-403b-bd54-4c013ab0e900 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:19.193525 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0814fd4-06ba-403b-bd54-4c013ab0e900 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:19.193958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0814fd4-06ba-403b-bd54-4c013ab0e900 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:22.188498 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f5c21a50-0a78-4ee9-afb8-8e830411f257 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 200 len: 38281 microversion: 2.1 time: 4.103360 Aug 30 07:52:22.193805 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 388/827] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:18 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 38281 bytes in 4105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:52:22.193948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-71cbd11f-b7a5-4464-8d41-7594864430fe tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c51bc10>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:22.222714 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-71cbd11f-b7a5-4464-8d41-7594864430fe tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 200 len: 286 microversion: 2.1 time: 0.032390 Aug 30 07:52:22.223272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 389/828] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:22 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:22.227598 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-41cb402b-87c0-47f5-940a-4dbb1311ff5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:22.228808 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-41cb402b-87c0-47f5-940a-4dbb1311ff5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:22.235225 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41cb402b-87c0-47f5-940a-4dbb1311ff5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:22.235672 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41cb402b-87c0-47f5-940a-4dbb1311ff5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:22.236435 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41cb402b-87c0-47f5-940a-4dbb1311ff5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:22.236869 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41cb402b-87c0-47f5-940a-4dbb1311ff5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:22.356416 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-41cb402b-87c0-47f5-940a-4dbb1311ff5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:22.363617 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-41cb402b-87c0-47f5-940a-4dbb1311ff5b tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1522 microversion: 2.1 time: 0.139420 Aug 30 07:52:22.364170 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 390/829] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:22 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:22.368719 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0fd86688-eba8-485e-9840-b736dacc277e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:22.369205 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0fd86688-eba8-485e-9840-b736dacc277e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:22.375292 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0fd86688-eba8-485e-9840-b736dacc277e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:22.375734 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0fd86688-eba8-485e-9840-b736dacc277e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:22.376488 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0fd86688-eba8-485e-9840-b736dacc277e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:22.376911 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0fd86688-eba8-485e-9840-b736dacc277e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:22.400692 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0fd86688-eba8-485e-9840-b736dacc277e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/ips" status: 200 len: 143 microversion: 2.1 time: 0.035383 Aug 30 07:52:22.401259 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 391/830] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 30 07:52:22 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/ips => generated 143 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:22.496196 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b0814fd4-06ba-403b-bd54-4c013ab0e900 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 3.314366 Aug 30 07:52:22.496766 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 440/831] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:19 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 3317 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:22.981689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-0c67f867-68a7-4394-b426-ce522c10aad3 req-590dd610-7b1f-4a06-944c-994448075243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fc5a1e-6b49-475e-85ec-93d172a0d3e2", "name": "network-vif-deleted", "tag": "ae18f657-8bf1-4e50-b57d-7f58cd1f4360"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:22.983499 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:52:22.983499 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:52:22.990662 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-0c67f867-68a7-4394-b426-ce522c10aad3 req-590dd610-7b1f-4a06-944c-994448075243 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:22.991103 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-0c67f867-68a7-4394-b426-ce522c10aad3 req-590dd610-7b1f-4a06-944c-994448075243 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:23.001885 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-0c67f867-68a7-4394-b426-ce522c10aad3 req-590dd610-7b1f-4a06-944c-994448075243 service nova] Creating event network-vif-deleted:ae18f657-8bf1-4e50-b57d-7f58cd1f4360 for instance 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 on hv-cinder-80619 Aug 30 07:52:23.006553 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-0c67f867-68a7-4394-b426-ce522c10aad3 req-590dd610-7b1f-4a06-944c-994448075243 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028558 Aug 30 07:52:23.007112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 392/832] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:52:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:23.234783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c4e68561-6541-4d78-ad03-c33207a98c35 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c137040>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:23.264416 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c4e68561-6541-4d78-ad03-c33207a98c35 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 200 len: 287 microversion: 2.1 time: 0.033579 Aug 30 07:52:23.264986 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 441/833] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:23 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:23.275800 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0e0a4181-2ba3-4898-956f-e9b60e05166c tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c14c550>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:23.331482 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0e0a4181-2ba3-4898-956f-e9b60e05166c tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 202 len: 0 microversion: 2.1 time: 0.060041 Aug 30 07:52:23.332053 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 393/834] 10.222.0.73 () {58 vars in 1254 bytes} [Mon Aug 30 07:52:23 2021] DELETE /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:23.340300 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dbbe038a-d367-4763-9d4f-b85cd7e9b2ff tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c148040>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:23.367558 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dbbe038a-d367-4763-9d4f-b85cd7e9b2ff tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 200 len: 286 microversion: 2.1 time: 0.030911 Aug 30 07:52:23.368139 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 442/835] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:23 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:23.380323 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ef529b12-7445-4b43-9f35-a08bd2c5a07d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:23.381059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ef529b12-7445-4b43-9f35-a08bd2c5a07d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:23.387751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef529b12-7445-4b43-9f35-a08bd2c5a07d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:23.388201 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef529b12-7445-4b43-9f35-a08bd2c5a07d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:23.388967 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef529b12-7445-4b43-9f35-a08bd2c5a07d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:23.389408 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef529b12-7445-4b43-9f35-a08bd2c5a07d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:23.419224 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef529b12-7445-4b43-9f35-a08bd2c5a07d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:23.419672 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ef529b12-7445-4b43-9f35-a08bd2c5a07d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:23.420124 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-ef529b12-7445-4b43-9f35-a08bd2c5a07d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lazy-loading 'fault' on Instance uuid 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:52:23.460465 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ef529b12-7445-4b43-9f35-a08bd2c5a07d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:23.467568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ef529b12-7445-4b43-9f35-a08bd2c5a07d tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1312 microversion: 2.1 time: 0.090837 Aug 30 07:52:23.468121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 394/836] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:23 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1312 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:23.507677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9d2d9ee8-8eed-4259-a3a5-6e3a5be3d0d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:23.508624 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9d2d9ee8-8eed-4259-a3a5-6e3a5be3d0d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:23.515769 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d2d9ee8-8eed-4259-a3a5-6e3a5be3d0d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:23.516286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d2d9ee8-8eed-4259-a3a5-6e3a5be3d0d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:23.517028 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d2d9ee8-8eed-4259-a3a5-6e3a5be3d0d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:23.517463 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d2d9ee8-8eed-4259-a3a5-6e3a5be3d0d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:24.380234 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6496a18f-ffc8-4112-8b0d-aac6a5e871aa tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c141af0>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:24.409442 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6496a18f-ffc8-4112-8b0d-aac6a5e871aa tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 200 len: 286 microversion: 2.1 time: 0.032902 Aug 30 07:52:24.409999 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 395/837] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:24 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:52:24.483927 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-74d6c629-5c11-40e6-9d1e-ddd5e6ee30ed tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:24.484525 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-74d6c629-5c11-40e6-9d1e-ddd5e6ee30ed tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:24.490377 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-74d6c629-5c11-40e6-9d1e-ddd5e6ee30ed tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:24.490824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-74d6c629-5c11-40e6-9d1e-ddd5e6ee30ed tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:24.491574 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-74d6c629-5c11-40e6-9d1e-ddd5e6ee30ed tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:24.492007 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-74d6c629-5c11-40e6-9d1e-ddd5e6ee30ed tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:24.522476 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-74d6c629-5c11-40e6-9d1e-ddd5e6ee30ed tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:24.522917 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-74d6c629-5c11-40e6-9d1e-ddd5e6ee30ed tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:24.523364 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-74d6c629-5c11-40e6-9d1e-ddd5e6ee30ed tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lazy-loading 'fault' on Instance uuid 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:52:24.562545 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-74d6c629-5c11-40e6-9d1e-ddd5e6ee30ed tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:24.569637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-74d6c629-5c11-40e6-9d1e-ddd5e6ee30ed tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1312 microversion: 2.1 time: 0.089260 Aug 30 07:52:24.570206 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 396/838] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:24 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:25.421318 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a24cef9b-8904-4e6f-ba09-48a6b1f4c6ea tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c2a5af0>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:25.449137 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a24cef9b-8904-4e6f-ba09-48a6b1f4c6ea tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 200 len: 286 microversion: 2.1 time: 0.031535 Aug 30 07:52:25.449748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 397/839] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:25 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:52:25.586872 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-486d12a1-a4da-43fa-b24c-703bd5307ad6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:25.587993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-486d12a1-a4da-43fa-b24c-703bd5307ad6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:25.593951 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-486d12a1-a4da-43fa-b24c-703bd5307ad6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:25.594438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-486d12a1-a4da-43fa-b24c-703bd5307ad6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:25.595188 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-486d12a1-a4da-43fa-b24c-703bd5307ad6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:25.595621 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-486d12a1-a4da-43fa-b24c-703bd5307ad6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:25.625653 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-486d12a1-a4da-43fa-b24c-703bd5307ad6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:25.626092 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-486d12a1-a4da-43fa-b24c-703bd5307ad6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:25.626575 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-486d12a1-a4da-43fa-b24c-703bd5307ad6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lazy-loading 'fault' on Instance uuid 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:52:25.672226 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-486d12a1-a4da-43fa-b24c-703bd5307ad6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:25.679478 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-486d12a1-a4da-43fa-b24c-703bd5307ad6 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1312 microversion: 2.1 time: 0.096254 Aug 30 07:52:25.680038 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 398/840] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:25 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:26.460637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-993883c2-c5bc-44b5-9bb7-3d2fae5b5ee7 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c2a59d0>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:26.488496 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-993883c2-c5bc-44b5-9bb7-3d2fae5b5ee7 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 200 len: 286 microversion: 2.1 time: 0.031453 Aug 30 07:52:26.489063 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 399/841] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:26 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:52:26.695920 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6bf35a20-76fe-4ba0-b706-a5cfdab19e71 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:26.696533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6bf35a20-76fe-4ba0-b706-a5cfdab19e71 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:26.702924 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bf35a20-76fe-4ba0-b706-a5cfdab19e71 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:26.703381 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bf35a20-76fe-4ba0-b706-a5cfdab19e71 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:26.704147 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bf35a20-76fe-4ba0-b706-a5cfdab19e71 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:26.704588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bf35a20-76fe-4ba0-b706-a5cfdab19e71 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:26.736473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bf35a20-76fe-4ba0-b706-a5cfdab19e71 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:26.736843 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bf35a20-76fe-4ba0-b706-a5cfdab19e71 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:26.737298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-6bf35a20-76fe-4ba0-b706-a5cfdab19e71 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lazy-loading 'fault' on Instance uuid 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:52:26.777221 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6bf35a20-76fe-4ba0-b706-a5cfdab19e71 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d71c0e1066f4c2aa935171a74051b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4656c08fc44eb93611972f4bebb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:26.784416 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6bf35a20-76fe-4ba0-b706-a5cfdab19e71 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 200 len: 1312 microversion: 2.1 time: 0.092226 Aug 30 07:52:26.784980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 400/842] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:26 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:27.183568 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9d2d9ee8-8eed-4259-a3a5-6e3a5be3d0d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 3.679427 Aug 30 07:52:27.184206 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 443/843] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:23 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 3681 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:27.500192 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e4a447ed-b4c7-4875-81cc-030d5cec36c0 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c186670>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:27.528738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e4a447ed-b4c7-4875-81cc-030d5cec36c0 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 200 len: 286 microversion: 2.1 time: 0.032155 Aug 30 07:52:27.529270 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 401/844] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:27 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:27.801902 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d066ef13-4626-4308-97be-b0683f08e9b7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:27.802531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d066ef13-4626-4308-97be-b0683f08e9b7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] [instance: 95fc5a1e-6b49-475e-85ec-93d172a0d3e2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:27.810033 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d066ef13-4626-4308-97be-b0683f08e9b7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:27.810517 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d066ef13-4626-4308-97be-b0683f08e9b7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:27.811271 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d066ef13-4626-4308-97be-b0683f08e9b7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:27.811706 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d066ef13-4626-4308-97be-b0683f08e9b7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:27.827059 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-d066ef13-4626-4308-97be-b0683f08e9b7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] HTTP exception thrown: Instance 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 could not be found. Aug 30 07:52:27.827654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d066ef13-4626-4308-97be-b0683f08e9b7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] Returning 404 to user: Instance 95fc5a1e-6b49-475e-85ec-93d172a0d3e2 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:52:27.828483 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d066ef13-4626-4308-97be-b0683f08e9b7 tempest-ServerRescueNegativeTestJSON-1910439739 tempest-ServerRescueNegativeTestJSON-1910439739-project] 10.222.0.73 "GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2" status: 404 len: 111 microversion: 2.1 time: 0.030746 Aug 30 07:52:27.829047 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 444/845] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:27 2021] GET /compute/v2.1/servers/95fc5a1e-6b49-475e-85ec-93d172a0d3e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:52:28.195808 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-691f7731-a8f6-404f-acff-d16954d0b0b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:28.196762 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-691f7731-a8f6-404f-acff-d16954d0b0b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:28.202920 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-691f7731-a8f6-404f-acff-d16954d0b0b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:28.203372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-691f7731-a8f6-404f-acff-d16954d0b0b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:28.204138 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-691f7731-a8f6-404f-acff-d16954d0b0b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:28.204573 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-691f7731-a8f6-404f-acff-d16954d0b0b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:28.266850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-691f7731-a8f6-404f-acff-d16954d0b0b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.074574 Aug 30 07:52:28.270884 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 402/846] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:28 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:28.541241 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2cbe517c-ede6-44b1-8ce2-edfbbfdff761 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c153820>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:28.565408 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-2cbe517c-ede6-44b1-8ce2-edfbbfdff761 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] HTTP exception thrown: Snapshot c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 could not be found. Aug 30 07:52:28.566005 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2cbe517c-ede6-44b1-8ce2-edfbbfdff761 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Returning 404 to user: Snapshot c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:52:28.566854 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2cbe517c-ede6-44b1-8ce2-edfbbfdff761 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9" status: 404 len: 111 microversion: 2.1 time: 0.030024 Aug 30 07:52:28.567382 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 445/847] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 07:52:28 2021] GET /compute/v2.1/os-snapshots/c73a2e2a-896b-4b36-a3fa-e860a3c8a0a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:52:28.576073 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e0e8d280-ff34-49b8-85a1-71a25c12d5e7 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c2a5af0>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:28.635551 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e0e8d280-ff34-49b8-85a1-71a25c12d5e7 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0" status: 202 len: 0 microversion: 2.1 time: 0.063611 Aug 30 07:52:28.636425 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 403/848] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 30 07:52:28 2021] DELETE /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:28.644340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ee76a3a2-7a58-48bc-a97b-30de303c4b42 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c145f70>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:28.698511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ee76a3a2-7a58-48bc-a97b-30de303c4b42 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0" status: 200 len: 344 microversion: 2.1 time: 0.057775 Aug 30 07:52:28.699127 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 446/849] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:52:28 2021] GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:29.161723 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-23b31bf1-0950-4302-a049-be7c2ca6dc88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6e84f33-2244-4d9f-ad9b-5b56a4b7cd66"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:29.162932 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-23b31bf1-0950-4302-a049-be7c2ca6dc88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:29.169476 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-23b31bf1-0950-4302-a049-be7c2ca6dc88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:29.169927 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-23b31bf1-0950-4302-a049-be7c2ca6dc88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:29.170735 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-23b31bf1-0950-4302-a049-be7c2ca6dc88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:29.171169 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-23b31bf1-0950-4302-a049-be7c2ca6dc88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:29.284040 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e7d6c80d-7528-4bb7-bc26-e1dfdb4dcca1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:29.284932 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e7d6c80d-7528-4bb7-bc26-e1dfdb4dcca1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:29.292843 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e7d6c80d-7528-4bb7-bc26-e1dfdb4dcca1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:29.293526 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e7d6c80d-7528-4bb7-bc26-e1dfdb4dcca1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:29.294510 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e7d6c80d-7528-4bb7-bc26-e1dfdb4dcca1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:29.295136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e7d6c80d-7528-4bb7-bc26-e1dfdb4dcca1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:29.365589 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e7d6c80d-7528-4bb7-bc26-e1dfdb4dcca1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.085602 Aug 30 07:52:29.367214 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 447/850] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:29 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:29.463889 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-23b31bf1-0950-4302-a049-be7c2ca6dc88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305784 Aug 30 07:52:29.464616 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 404/851] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:52:29 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:29.711936 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b97921d0-d755-4374-9292-fd343393f3a3 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c148b80>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:29.741952 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-b97921d0-d755-4374-9292-fd343393f3a3 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] HTTP exception thrown: Volume 16199fe9-9ff5-4724-88fa-86d6e4222ea0 could not be found. Aug 30 07:52:29.742604 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b97921d0-d755-4374-9292-fd343393f3a3 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Returning 404 to user: Volume 16199fe9-9ff5-4724-88fa-86d6e4222ea0 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:52:29.744723 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b97921d0-d755-4374-9292-fd343393f3a3 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0" status: 404 len: 109 microversion: 2.1 time: 0.035837 Aug 30 07:52:29.745537 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 448/852] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:52:29 2021] GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:52:29.760660 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d56f1400-f95c-429a-8158-402b45f5bac6 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c1865e0>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:29.792457 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-d56f1400-f95c-429a-8158-402b45f5bac6 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] HTTP exception thrown: Volume 16199fe9-9ff5-4724-88fa-86d6e4222ea0 could not be found. Aug 30 07:52:29.793090 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d56f1400-f95c-429a-8158-402b45f5bac6 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Returning 404 to user: Volume 16199fe9-9ff5-4724-88fa-86d6e4222ea0 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:52:29.793938 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d56f1400-f95c-429a-8158-402b45f5bac6 tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0" status: 404 len: 109 microversion: 2.1 time: 0.038330 Aug 30 07:52:29.794884 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 405/853] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 30 07:52:29 2021] DELETE /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:52:29.802430 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-331e5f91-b1fa-4dff-b866-63cd45784fad tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Calling method '.version_select at 0x7f341c153e50>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:29.832056 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-331e5f91-b1fa-4dff-b866-63cd45784fad tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] HTTP exception thrown: Volume 16199fe9-9ff5-4724-88fa-86d6e4222ea0 could not be found. Aug 30 07:52:29.832690 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-331e5f91-b1fa-4dff-b866-63cd45784fad tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] Returning 404 to user: Volume 16199fe9-9ff5-4724-88fa-86d6e4222ea0 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:52:29.833641 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-331e5f91-b1fa-4dff-b866-63cd45784fad tempest-VolumesSnapshotsTestJSON-830347074 tempest-VolumesSnapshotsTestJSON-830347074-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0" status: 404 len: 109 microversion: 2.1 time: 0.034873 Aug 30 07:52:29.834213 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 449/854] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:52:29 2021] GET /compute/v2.1/os-volumes/16199fe9-9ff5-4724-88fa-86d6e4222ea0 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:52:30.379480 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1063c9cc-1cf3-4bba-9726-7673822e51d9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:30.380560 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1063c9cc-1cf3-4bba-9726-7673822e51d9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:30.387434 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1063c9cc-1cf3-4bba-9726-7673822e51d9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:30.387878 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1063c9cc-1cf3-4bba-9726-7673822e51d9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:30.388646 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1063c9cc-1cf3-4bba-9726-7673822e51d9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:30.389078 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1063c9cc-1cf3-4bba-9726-7673822e51d9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:30.450745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1063c9cc-1cf3-4bba-9726-7673822e51d9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.076061 Aug 30 07:52:30.454579 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 406/855] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:30 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:31.462981 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9383d7e5-5a7b-4e6d-985b-7ec08f351a68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:31.464748 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9383d7e5-5a7b-4e6d-985b-7ec08f351a68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:31.471235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9383d7e5-5a7b-4e6d-985b-7ec08f351a68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:31.472168 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9383d7e5-5a7b-4e6d-985b-7ec08f351a68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:31.472457 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9383d7e5-5a7b-4e6d-985b-7ec08f351a68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:31.473802 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9383d7e5-5a7b-4e6d-985b-7ec08f351a68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:31.550194 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9383d7e5-5a7b-4e6d-985b-7ec08f351a68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.091566 Aug 30 07:52:31.551048 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 450/856] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:31 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:31.568247 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4d1dd4c4-4cdb-48bc-b2df-cbe10c1a9a99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:31.569056 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4d1dd4c4-4cdb-48bc-b2df-cbe10c1a9a99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:31.578036 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4d1dd4c4-4cdb-48bc-b2df-cbe10c1a9a99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:31.578695 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4d1dd4c4-4cdb-48bc-b2df-cbe10c1a9a99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:31.579993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4d1dd4c4-4cdb-48bc-b2df-cbe10c1a9a99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:31.581157 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4d1dd4c4-4cdb-48bc-b2df-cbe10c1a9a99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:31.706712 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-4d1dd4c4-4cdb-48bc-b2df-cbe10c1a9a99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lazy-loading 'services' on Instance uuid d4bee8b8-41a8-4be5-92f5-b53a575f9f7e {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:52:31.775600 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4d1dd4c4-4cdb-48bc-b2df-cbe10c1a9a99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e/os-volume_attachments/ce70ca3a-d541-4f20-bb4a-03b93e215c3f" status: 202 len: 0 microversion: 2.1 time: 0.211320 Aug 30 07:52:31.776637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 407/857] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:52:31 2021] DELETE /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e/os-volume_attachments/ce70ca3a-d541-4f20-bb4a-03b93e215c3f => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:32.562570 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ed462297-6325-41dc-bc09-1d3670646525 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:32.563722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ed462297-6325-41dc-bc09-1d3670646525 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:32.570592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ed462297-6325-41dc-bc09-1d3670646525 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:32.571110 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ed462297-6325-41dc-bc09-1d3670646525 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:32.572447 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ed462297-6325-41dc-bc09-1d3670646525 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:32.572880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ed462297-6325-41dc-bc09-1d3670646525 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:32.647146 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ed462297-6325-41dc-bc09-1d3670646525 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.088630 Aug 30 07:52:32.647968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 451/858] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:32 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:33.661442 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-697e94b0-ec1b-4ba3-8f58-796bd71864f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:33.662539 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-697e94b0-ec1b-4ba3-8f58-796bd71864f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:33.669233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-697e94b0-ec1b-4ba3-8f58-796bd71864f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:33.669676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-697e94b0-ec1b-4ba3-8f58-796bd71864f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:33.670470 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-697e94b0-ec1b-4ba3-8f58-796bd71864f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:33.670899 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-697e94b0-ec1b-4ba3-8f58-796bd71864f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:33.743371 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-697e94b0-ec1b-4ba3-8f58-796bd71864f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.086570 Aug 30 07:52:33.745139 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 408/859] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:33 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:34.756760 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0c02f606-03e0-4f84-9d82-47894cfaf49a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:34.757867 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0c02f606-03e0-4f84-9d82-47894cfaf49a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:34.765175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0c02f606-03e0-4f84-9d82-47894cfaf49a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:34.765707 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0c02f606-03e0-4f84-9d82-47894cfaf49a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:34.766581 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0c02f606-03e0-4f84-9d82-47894cfaf49a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:34.767182 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0c02f606-03e0-4f84-9d82-47894cfaf49a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:34.832157 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0c02f606-03e0-4f84-9d82-47894cfaf49a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.079111 Aug 30 07:52:34.833825 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 452/860] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:34 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:35.845311 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-689c400d-2c98-49b8-ae3e-32ad0b3b94f8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:35.846476 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-689c400d-2c98-49b8-ae3e-32ad0b3b94f8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:35.853767 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-689c400d-2c98-49b8-ae3e-32ad0b3b94f8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:35.854244 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-689c400d-2c98-49b8-ae3e-32ad0b3b94f8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:35.855021 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-689c400d-2c98-49b8-ae3e-32ad0b3b94f8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:35.855464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-689c400d-2c98-49b8-ae3e-32ad0b3b94f8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:36.014000 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-689c400d-2c98-49b8-ae3e-32ad0b3b94f8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.173268 Aug 30 07:52:36.014872 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 409/861] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:35 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:37.025924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e0ea3fc2-35da-4a7f-96f9-9df77621969e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:37.026942 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e0ea3fc2-35da-4a7f-96f9-9df77621969e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:37.033260 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0ea3fc2-35da-4a7f-96f9-9df77621969e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:37.033703 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0ea3fc2-35da-4a7f-96f9-9df77621969e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:37.034499 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0ea3fc2-35da-4a7f-96f9-9df77621969e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:37.034976 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0ea3fc2-35da-4a7f-96f9-9df77621969e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:39.665458 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e0ea3fc2-35da-4a7f-96f9-9df77621969e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 2.643955 Aug 30 07:52:39.666172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 453/862] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:37 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 2646 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:40.215739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b9f76c41-56b8-43be-82ac-1b3a9f7c59ba tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:40.221968 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b9f76c41-56b8-43be-82ac-1b3a9f7c59ba tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:40.222439 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b9f76c41-56b8-43be-82ac-1b3a9f7c59ba tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:40.282685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b9f76c41-56b8-43be-82ac-1b3a9f7c59ba tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Going to try to stop instance {{(pid=114670) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 30 07:52:40.329907 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b9f76c41-56b8-43be-82ac-1b3a9f7c59ba tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 202 len: 0 microversion: 2.1 time: 0.118592 Aug 30 07:52:40.330772 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 410/863] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:52:40 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:40.344231 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-abd67931-12a6-4bf7-8ee7-69cd35cade35 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:40.344231 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-abd67931-12a6-4bf7-8ee7-69cd35cade35 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:40.347136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-abd67931-12a6-4bf7-8ee7-69cd35cade35 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:40.347588 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-abd67931-12a6-4bf7-8ee7-69cd35cade35 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:40.348365 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-abd67931-12a6-4bf7-8ee7-69cd35cade35 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:40.348798 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-abd67931-12a6-4bf7-8ee7-69cd35cade35 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:40.478841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-abd67931-12a6-4bf7-8ee7-69cd35cade35 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:40.486645 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-abd67931-12a6-4bf7-8ee7-69cd35cade35 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.151683 Aug 30 07:52:40.487219 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 454/864] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:40 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:40.678422 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3be3cf43-fd29-45c0-876f-1ab877705c98 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:40.679330 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3be3cf43-fd29-45c0-876f-1ab877705c98 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:40.685753 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3be3cf43-fd29-45c0-876f-1ab877705c98 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:40.686227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3be3cf43-fd29-45c0-876f-1ab877705c98 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:40.686997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3be3cf43-fd29-45c0-876f-1ab877705c98 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:40.687427 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3be3cf43-fd29-45c0-876f-1ab877705c98 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:40.750870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3be3cf43-fd29-45c0-876f-1ab877705c98 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.076237 Aug 30 07:52:40.751527 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 411/865] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:40 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:41.405611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8c36d506-f032-4c56-942d-587f42ffe793 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:41.406203 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8c36d506-f032-4c56-942d-587f42ffe793 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:41.412307 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8c36d506-f032-4c56-942d-587f42ffe793 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:41.412752 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8c36d506-f032-4c56-942d-587f42ffe793 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:41.413519 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8c36d506-f032-4c56-942d-587f42ffe793 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:41.413952 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8c36d506-f032-4c56-942d-587f42ffe793 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:41.440535 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8c36d506-f032-4c56-942d-587f42ffe793 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:52:41.506036 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0ab0cbc6-57f8-4355-bb07-0164bae93b54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:41.506615 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0ab0cbc6-57f8-4355-bb07-0164bae93b54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:41.513590 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ab0cbc6-57f8-4355-bb07-0164bae93b54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:41.514311 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ab0cbc6-57f8-4355-bb07-0164bae93b54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:41.515399 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ab0cbc6-57f8-4355-bb07-0164bae93b54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:41.515811 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ab0cbc6-57f8-4355-bb07-0164bae93b54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:41.518847 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8c36d506-f032-4c56-942d-587f42ffe793 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 204 len: 0 microversion: 2.1 time: 0.117401 Aug 30 07:52:41.520828 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 455/866] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:52:41 2021] DELETE /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:52:41.531175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4007e902-a9de-45f8-b167-2eea2b518f09 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:41.532388 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4007e902-a9de-45f8-b167-2eea2b518f09 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:41.539120 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4007e902-a9de-45f8-b167-2eea2b518f09 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:41.540339 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4007e902-a9de-45f8-b167-2eea2b518f09 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:41.541187 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4007e902-a9de-45f8-b167-2eea2b518f09 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:41.542180 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4007e902-a9de-45f8-b167-2eea2b518f09 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:41.685819 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0ab0cbc6-57f8-4355-bb07-0164bae93b54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:41.694341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0ab0cbc6-57f8-4355-bb07-0164bae93b54 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.192894 Aug 30 07:52:41.696050 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 412/867] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:41 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:41.703886 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4007e902-a9de-45f8-b167-2eea2b518f09 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:41.713486 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4007e902-a9de-45f8-b167-2eea2b518f09 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1513 microversion: 2.1 time: 0.188733 Aug 30 07:52:41.714141 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 456/868] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:41 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:41.765756 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3edaef70-3f38-46b4-8331-3c80a0bfd16a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:41.766880 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3edaef70-3f38-46b4-8331-3c80a0bfd16a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:41.773386 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3edaef70-3f38-46b4-8331-3c80a0bfd16a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:41.774484 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3edaef70-3f38-46b4-8331-3c80a0bfd16a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:41.775325 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3edaef70-3f38-46b4-8331-3c80a0bfd16a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:41.775743 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3edaef70-3f38-46b4-8331-3c80a0bfd16a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:41.856652 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3edaef70-3f38-46b4-8331-3c80a0bfd16a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.096861 Aug 30 07:52:41.857953 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 413/869] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:41 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:42.713173 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-04857bed-ddea-424e-b5ed-f4b1961008ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:42.713804 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-04857bed-ddea-424e-b5ed-f4b1961008ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:42.719913 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-04857bed-ddea-424e-b5ed-f4b1961008ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:42.720356 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-04857bed-ddea-424e-b5ed-f4b1961008ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:42.721110 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-04857bed-ddea-424e-b5ed-f4b1961008ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:42.721537 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-04857bed-ddea-424e-b5ed-f4b1961008ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:42.731637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-321dac39-3c2b-4aa4-b9ab-95eb8c98550e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:42.732339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-321dac39-3c2b-4aa4-b9ab-95eb8c98550e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:42.738881 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-321dac39-3c2b-4aa4-b9ab-95eb8c98550e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:42.739323 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-321dac39-3c2b-4aa4-b9ab-95eb8c98550e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:42.740095 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-321dac39-3c2b-4aa4-b9ab-95eb8c98550e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:42.740529 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-321dac39-3c2b-4aa4-b9ab-95eb8c98550e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:42.841540 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-04857bed-ddea-424e-b5ed-f4b1961008ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:42.849391 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-04857bed-ddea-424e-b5ed-f4b1961008ed tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.140372 Aug 30 07:52:42.849964 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 457/870] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:42 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:42.865547 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-321dac39-3c2b-4aa4-b9ab-95eb8c98550e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:42.867625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bf707a58-f9b8-4f2c-b227-656c151d753c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:42.868602 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bf707a58-f9b8-4f2c-b227-656c151d753c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:42.874063 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-321dac39-3c2b-4aa4-b9ab-95eb8c98550e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1513 microversion: 2.1 time: 0.147093 Aug 30 07:52:42.874539 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf707a58-f9b8-4f2c-b227-656c151d753c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:42.874694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 414/871] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:42 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:42.874983 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf707a58-f9b8-4f2c-b227-656c151d753c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:42.875744 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf707a58-f9b8-4f2c-b227-656c151d753c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:42.876187 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf707a58-f9b8-4f2c-b227-656c151d753c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:43.868138 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b97a262b-6369-4339-b312-656ca78745b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:43.868755 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b97a262b-6369-4339-b312-656ca78745b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:43.875260 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b97a262b-6369-4339-b312-656ca78745b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:43.875711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b97a262b-6369-4339-b312-656ca78745b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:43.876479 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b97a262b-6369-4339-b312-656ca78745b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:43.876919 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b97a262b-6369-4339-b312-656ca78745b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:43.997080 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b97a262b-6369-4339-b312-656ca78745b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:44.004830 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b97a262b-6369-4339-b312-656ca78745b0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.141105 Aug 30 07:52:44.005393 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 415/872] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:43 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:44.009628 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-11f2b17b-428b-4eeb-a9f8-ef80af545729 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:44.010265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-11f2b17b-428b-4eeb-a9f8-ef80af545729 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:44.015730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-11f2b17b-428b-4eeb-a9f8-ef80af545729 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:44.016169 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-11f2b17b-428b-4eeb-a9f8-ef80af545729 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:44.016940 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-11f2b17b-428b-4eeb-a9f8-ef80af545729 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:44.017374 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-11f2b17b-428b-4eeb-a9f8-ef80af545729 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:44.136885 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-11f2b17b-428b-4eeb-a9f8-ef80af545729 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:44.144205 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-11f2b17b-428b-4eeb-a9f8-ef80af545729 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1513 microversion: 2.1 time: 0.137869 Aug 30 07:52:44.144767 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 416/873] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:44 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1513 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:45.021729 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-31960661-4df1-46f3-bee6-a6f82b2cf8cb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:45.022368 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-31960661-4df1-46f3-bee6-a6f82b2cf8cb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:45.028164 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-31960661-4df1-46f3-bee6-a6f82b2cf8cb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:45.028625 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-31960661-4df1-46f3-bee6-a6f82b2cf8cb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:45.029358 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-31960661-4df1-46f3-bee6-a6f82b2cf8cb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:45.029783 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-31960661-4df1-46f3-bee6-a6f82b2cf8cb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:45.151330 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-31960661-4df1-46f3-bee6-a6f82b2cf8cb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:45.159126 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-31960661-4df1-46f3-bee6-a6f82b2cf8cb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.140985 Aug 30 07:52:45.159712 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 417/874] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:45 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:45.163880 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-49945a6d-ac8d-4133-b2d1-0c8c75dec898 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:45.164696 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-49945a6d-ac8d-4133-b2d1-0c8c75dec898 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:45.170104 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49945a6d-ac8d-4133-b2d1-0c8c75dec898 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:45.170585 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49945a6d-ac8d-4133-b2d1-0c8c75dec898 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:45.171346 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49945a6d-ac8d-4133-b2d1-0c8c75dec898 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:45.171780 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49945a6d-ac8d-4133-b2d1-0c8c75dec898 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:45.292709 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-49945a6d-ac8d-4133-b2d1-0c8c75dec898 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:45.300051 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-49945a6d-ac8d-4133-b2d1-0c8c75dec898 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1513 microversion: 2.1 time: 0.139405 Aug 30 07:52:45.300598 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 418/875] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:45 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1513 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:45.786344 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bf707a58-f9b8-4f2c-b227-656c151d753c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 2.922066 Aug 30 07:52:45.790191 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 458/876] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:42 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 2924 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:46.176083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3dc24ca7-ad81-4778-8f7b-d843d3315bce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:46.176692 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3dc24ca7-ad81-4778-8f7b-d843d3315bce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:46.183317 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3dc24ca7-ad81-4778-8f7b-d843d3315bce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:46.183757 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3dc24ca7-ad81-4778-8f7b-d843d3315bce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:46.184521 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3dc24ca7-ad81-4778-8f7b-d843d3315bce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:46.184946 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3dc24ca7-ad81-4778-8f7b-d843d3315bce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:46.304516 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3dc24ca7-ad81-4778-8f7b-d843d3315bce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:46.312357 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3dc24ca7-ad81-4778-8f7b-d843d3315bce tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.139917 Aug 30 07:52:46.312925 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 419/877] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:46 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:46.317467 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f76e8d92-5ab2-4a94-830b-fa7937958c28 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:46.318175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f76e8d92-5ab2-4a94-830b-fa7937958c28 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:46.326296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f76e8d92-5ab2-4a94-830b-fa7937958c28 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:46.326735 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f76e8d92-5ab2-4a94-830b-fa7937958c28 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:46.327626 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f76e8d92-5ab2-4a94-830b-fa7937958c28 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:46.328054 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f76e8d92-5ab2-4a94-830b-fa7937958c28 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:46.604879 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f76e8d92-5ab2-4a94-830b-fa7937958c28 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:46.612106 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f76e8d92-5ab2-4a94-830b-fa7937958c28 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1513 microversion: 2.1 time: 0.298835 Aug 30 07:52:46.612658 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 459/878] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:46 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1513 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:46.798442 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ecd66214-9766-40c1-a2f8-9f1c2948c8f1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:46.799362 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ecd66214-9766-40c1-a2f8-9f1c2948c8f1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:46.805670 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ecd66214-9766-40c1-a2f8-9f1c2948c8f1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:46.806110 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ecd66214-9766-40c1-a2f8-9f1c2948c8f1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:46.806901 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ecd66214-9766-40c1-a2f8-9f1c2948c8f1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:46.807444 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ecd66214-9766-40c1-a2f8-9f1c2948c8f1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:46.939565 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ecd66214-9766-40c1-a2f8-9f1c2948c8f1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.144718 Aug 30 07:52:46.940242 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 420/879] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:46 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:47.329912 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-629a22e7-a8c4-4a1b-9441-f63fd35c1884 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:47.330467 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-629a22e7-a8c4-4a1b-9441-f63fd35c1884 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:47.337181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-629a22e7-a8c4-4a1b-9441-f63fd35c1884 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:47.337694 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-629a22e7-a8c4-4a1b-9441-f63fd35c1884 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:47.338545 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-629a22e7-a8c4-4a1b-9441-f63fd35c1884 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:47.338983 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-629a22e7-a8c4-4a1b-9441-f63fd35c1884 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:47.463826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-629a22e7-a8c4-4a1b-9441-f63fd35c1884 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:47.472035 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-629a22e7-a8c4-4a1b-9441-f63fd35c1884 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.145675 Aug 30 07:52:47.472571 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 460/880] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:47 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:47.630388 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-95ad643a-bdb2-47ac-8f62-32169acb1368 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:47.631041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-95ad643a-bdb2-47ac-8f62-32169acb1368 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:47.638054 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-95ad643a-bdb2-47ac-8f62-32169acb1368 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:47.638540 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-95ad643a-bdb2-47ac-8f62-32169acb1368 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:47.639515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-95ad643a-bdb2-47ac-8f62-32169acb1368 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:47.640112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-95ad643a-bdb2-47ac-8f62-32169acb1368 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:47.927877 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-f31ceb03-2b53-48e0-9598-bee373b57726 req-e9f3fff3-a6fe-482a-b65d-ca141c706f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bee8b8-41a8-4be5-92f5-b53a575f9f7e", "name": "network-vif-deleted", "tag": "3afa3cbd-9ebd-4e43-865d-c8d09a8b644b"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:47.929505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:52:47.929505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:52:47.936339 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-f31ceb03-2b53-48e0-9598-bee373b57726 req-e9f3fff3-a6fe-482a-b65d-ca141c706f05 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:47.937087 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-f31ceb03-2b53-48e0-9598-bee373b57726 req-e9f3fff3-a6fe-482a-b65d-ca141c706f05 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:47.949853 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-f31ceb03-2b53-48e0-9598-bee373b57726 req-e9f3fff3-a6fe-482a-b65d-ca141c706f05 service nova] Creating event network-vif-deleted:3afa3cbd-9ebd-4e43-865d-c8d09a8b644b for instance d4bee8b8-41a8-4be5-92f5-b53a575f9f7e on hv-cinder-80619 Aug 30 07:52:47.955864 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-f31ceb03-2b53-48e0-9598-bee373b57726 req-e9f3fff3-a6fe-482a-b65d-ca141c706f05 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031443 Aug 30 07:52:47.956496 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 461/881] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:52:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:52:47.963194 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8711050e-fe82-4c76-baa1-2f02dcd0ed11 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:47.964229 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8711050e-fe82-4c76-baa1-2f02dcd0ed11 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:47.970744 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8711050e-fe82-4c76-baa1-2f02dcd0ed11 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:47.971630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8711050e-fe82-4c76-baa1-2f02dcd0ed11 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:47.972552 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8711050e-fe82-4c76-baa1-2f02dcd0ed11 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:47.975619 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-95ad643a-bdb2-47ac-8f62-32169acb1368 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:47.982863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8711050e-fe82-4c76-baa1-2f02dcd0ed11 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:47.985466 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-95ad643a-bdb2-47ac-8f62-32169acb1368 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 200 len: 1513 microversion: 2.1 time: 0.359075 Aug 30 07:52:47.996736 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 421/882] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:47 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 1513 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:48.064265 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8711050e-fe82-4c76-baa1-2f02dcd0ed11 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.106120 Aug 30 07:52:48.065108 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 462/883] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:47 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:48.489523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bf2ca96e-422c-42b9-8257-1c00c2a05ace tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:48.490135 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bf2ca96e-422c-42b9-8257-1c00c2a05ace tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:48.496858 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf2ca96e-422c-42b9-8257-1c00c2a05ace tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:48.497303 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf2ca96e-422c-42b9-8257-1c00c2a05ace tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:48.498068 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf2ca96e-422c-42b9-8257-1c00c2a05ace tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:48.498532 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf2ca96e-422c-42b9-8257-1c00c2a05ace tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:48.619790 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-bf2ca96e-422c-42b9-8257-1c00c2a05ace tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:48.627469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bf2ca96e-422c-42b9-8257-1c00c2a05ace tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.141565 Aug 30 07:52:48.628039 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 422/884] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:48 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:49.005256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8ac58b93-3978-4e81-9ee6-caafc9ac55ea tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:49.005954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8ac58b93-3978-4e81-9ee6-caafc9ac55ea tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: d4bee8b8-41a8-4be5-92f5-b53a575f9f7e] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:49.012628 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8ac58b93-3978-4e81-9ee6-caafc9ac55ea tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:49.012997 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8ac58b93-3978-4e81-9ee6-caafc9ac55ea tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:49.013765 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8ac58b93-3978-4e81-9ee6-caafc9ac55ea tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:49.014217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8ac58b93-3978-4e81-9ee6-caafc9ac55ea tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:49.028443 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-8ac58b93-3978-4e81-9ee6-caafc9ac55ea tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] HTTP exception thrown: Instance d4bee8b8-41a8-4be5-92f5-b53a575f9f7e could not be found. Aug 30 07:52:49.029043 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8ac58b93-3978-4e81-9ee6-caafc9ac55ea tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Returning 404 to user: Instance d4bee8b8-41a8-4be5-92f5-b53a575f9f7e could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:52:49.029890 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8ac58b93-3978-4e81-9ee6-caafc9ac55ea tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e" status: 404 len: 111 microversion: 2.1 time: 0.029203 Aug 30 07:52:49.030460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 463/885] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:48 2021] GET /compute/v2.1/servers/d4bee8b8-41a8-4be5-92f5-b53a575f9f7e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:52:49.077222 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fa3957c7-972f-4b0c-ac6d-87fd581095be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:49.078225 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fa3957c7-972f-4b0c-ac6d-87fd581095be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:49.084595 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa3957c7-972f-4b0c-ac6d-87fd581095be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:49.085257 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa3957c7-972f-4b0c-ac6d-87fd581095be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:49.086270 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa3957c7-972f-4b0c-ac6d-87fd581095be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:49.087338 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fa3957c7-972f-4b0c-ac6d-87fd581095be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:49.152497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fa3957c7-972f-4b0c-ac6d-87fd581095be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.078432 Aug 30 07:52:49.153211 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 423/886] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:49 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:49.644628 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cdfdfee7-8513-4a80-8377-aeaacebbe4ac tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:49.645184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cdfdfee7-8513-4a80-8377-aeaacebbe4ac tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:49.651605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cdfdfee7-8513-4a80-8377-aeaacebbe4ac tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:49.652042 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cdfdfee7-8513-4a80-8377-aeaacebbe4ac tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:49.653167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cdfdfee7-8513-4a80-8377-aeaacebbe4ac tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:49.653607 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cdfdfee7-8513-4a80-8377-aeaacebbe4ac tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:49.778426 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-cdfdfee7-8513-4a80-8377-aeaacebbe4ac tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:49.786341 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cdfdfee7-8513-4a80-8377-aeaacebbe4ac tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.145406 Aug 30 07:52:49.786895 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 464/887] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:49 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:50.163844 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d32ee635-153d-424e-8a3b-c43d1560502f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:50.164982 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d32ee635-153d-424e-8a3b-c43d1560502f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:50.171394 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d32ee635-153d-424e-8a3b-c43d1560502f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:50.171928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d32ee635-153d-424e-8a3b-c43d1560502f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:50.172693 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d32ee635-153d-424e-8a3b-c43d1560502f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:50.173119 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d32ee635-153d-424e-8a3b-c43d1560502f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:50.803457 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f0df8ecb-d0b1-45c0-ab60-e3e1465fcced tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:50.804068 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f0df8ecb-d0b1-45c0-ab60-e3e1465fcced tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:50.810987 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f0df8ecb-d0b1-45c0-ab60-e3e1465fcced tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:50.811438 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f0df8ecb-d0b1-45c0-ab60-e3e1465fcced tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:50.812206 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f0df8ecb-d0b1-45c0-ab60-e3e1465fcced tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:50.812640 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f0df8ecb-d0b1-45c0-ab60-e3e1465fcced tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:50.947890 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f0df8ecb-d0b1-45c0-ab60-e3e1465fcced tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:50.956010 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f0df8ecb-d0b1-45c0-ab60-e3e1465fcced tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.156293 Aug 30 07:52:50.956585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 465/888] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:50 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:51.972466 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fc74a161-eef0-4429-a54c-373662249cd2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:51.973080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fc74a161-eef0-4429-a54c-373662249cd2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:51.980868 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc74a161-eef0-4429-a54c-373662249cd2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:51.981485 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc74a161-eef0-4429-a54c-373662249cd2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:51.982314 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc74a161-eef0-4429-a54c-373662249cd2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:51.982755 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc74a161-eef0-4429-a54c-373662249cd2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:52.105663 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-fc74a161-eef0-4429-a54c-373662249cd2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:52.113407 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fc74a161-eef0-4429-a54c-373662249cd2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.144551 Aug 30 07:52:52.113975 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 466/889] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:51 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:52.781286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 07:52:52.781618 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: Mon Aug 30 07:52:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 07:52:53.323012 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d32ee635-153d-424e-8a3b-c43d1560502f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 3.162464 Aug 30 07:52:53.324742 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 424/890] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:50 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 3166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:53.358982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-054afbe7-55f2-4f24-ae74-bf81a88dd73c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:53.359639 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-054afbe7-55f2-4f24-ae74-bf81a88dd73c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:53.365605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-054afbe7-55f2-4f24-ae74-bf81a88dd73c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:53.366254 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-054afbe7-55f2-4f24-ae74-bf81a88dd73c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:53.367074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-054afbe7-55f2-4f24-ae74-bf81a88dd73c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:53.368975 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-054afbe7-55f2-4f24-ae74-bf81a88dd73c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:53.497155 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-054afbe7-55f2-4f24-ae74-bf81a88dd73c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:53.504731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-054afbe7-55f2-4f24-ae74-bf81a88dd73c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.377275 Aug 30 07:52:53.505371 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 467/891] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:53 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:54.335434 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3045832f-5007-46cb-b6ce-ab521dc5beda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:54.337573 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3045832f-5007-46cb-b6ce-ab521dc5beda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:54.345179 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3045832f-5007-46cb-b6ce-ab521dc5beda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:54.345179 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3045832f-5007-46cb-b6ce-ab521dc5beda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:54.353459 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3045832f-5007-46cb-b6ce-ab521dc5beda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:54.354877 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3045832f-5007-46cb-b6ce-ab521dc5beda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:54.423121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3045832f-5007-46cb-b6ce-ab521dc5beda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.091721 Aug 30 07:52:54.427013 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 425/892] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:54 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:52:54.522379 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b8378026-567a-4378-aaa7-b2cb4aae1d8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:54.522989 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b8378026-567a-4378-aaa7-b2cb4aae1d8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:54.529706 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8378026-567a-4378-aaa7-b2cb4aae1d8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:54.530179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8378026-567a-4378-aaa7-b2cb4aae1d8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:54.530961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8378026-567a-4378-aaa7-b2cb4aae1d8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:54.531604 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8378026-567a-4378-aaa7-b2cb4aae1d8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:54.662606 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b8378026-567a-4378-aaa7-b2cb4aae1d8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:54.671828 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b8378026-567a-4378-aaa7-b2cb4aae1d8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.152952 Aug 30 07:52:54.672395 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 468/893] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:54 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:55.435589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-69f87beb-9288-4ee1-82d8-ec2a166435f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:55.436597 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-69f87beb-9288-4ee1-82d8-ec2a166435f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:55.443170 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-69f87beb-9288-4ee1-82d8-ec2a166435f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:55.443617 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-69f87beb-9288-4ee1-82d8-ec2a166435f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:55.444389 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-69f87beb-9288-4ee1-82d8-ec2a166435f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:55.444821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-69f87beb-9288-4ee1-82d8-ec2a166435f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:55.505169 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-69f87beb-9288-4ee1-82d8-ec2a166435f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 28645 microversion: 2.20 time: 0.073372 Aug 30 07:52:55.510012 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 426/894] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:55 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 28645 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:52:55.689106 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-06e6433a-ad8c-4fd1-a6e4-aa89790dc2d7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:55.690490 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-06e6433a-ad8c-4fd1-a6e4-aa89790dc2d7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:55.698362 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06e6433a-ad8c-4fd1-a6e4-aa89790dc2d7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:55.698962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06e6433a-ad8c-4fd1-a6e4-aa89790dc2d7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:55.699868 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06e6433a-ad8c-4fd1-a6e4-aa89790dc2d7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:55.700415 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06e6433a-ad8c-4fd1-a6e4-aa89790dc2d7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:55.859887 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-06e6433a-ad8c-4fd1-a6e4-aa89790dc2d7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:55.868990 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-06e6433a-ad8c-4fd1-a6e4-aa89790dc2d7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.183682 Aug 30 07:52:55.869648 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 469/895] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:55 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:52:56.517853 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5b61e503-2c35-4b27-9e59-3349a3bd9737 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:52:56.518876 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5b61e503-2c35-4b27-9e59-3349a3bd9737 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:56.526434 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b61e503-2c35-4b27-9e59-3349a3bd9737 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:56.526887 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b61e503-2c35-4b27-9e59-3349a3bd9737 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:56.527656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b61e503-2c35-4b27-9e59-3349a3bd9737 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:56.528121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5b61e503-2c35-4b27-9e59-3349a3bd9737 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:56.885958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3a87a9ad-fdaa-46d8-812e-016971663700 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:56.886623 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3a87a9ad-fdaa-46d8-812e-016971663700 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:56.892542 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3a87a9ad-fdaa-46d8-812e-016971663700 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:56.892994 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3a87a9ad-fdaa-46d8-812e-016971663700 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:56.893797 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3a87a9ad-fdaa-46d8-812e-016971663700 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:56.894262 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3a87a9ad-fdaa-46d8-812e-016971663700 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:57.070074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3a87a9ad-fdaa-46d8-812e-016971663700 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:57.078899 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3a87a9ad-fdaa-46d8-812e-016971663700 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.197187 Aug 30 07:52:57.079469 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 470/896] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:56 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:58.096605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-60fa0e9f-e09d-47e6-afc1-d33da2338160 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:58.097528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-60fa0e9f-e09d-47e6-afc1-d33da2338160 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:58.105590 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-60fa0e9f-e09d-47e6-afc1-d33da2338160 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:58.106432 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-60fa0e9f-e09d-47e6-afc1-d33da2338160 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:58.107383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-60fa0e9f-e09d-47e6-afc1-d33da2338160 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:58.107826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-60fa0e9f-e09d-47e6-afc1-d33da2338160 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:58.251108 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-60fa0e9f-e09d-47e6-afc1-d33da2338160 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:58.259511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-60fa0e9f-e09d-47e6-afc1-d33da2338160 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.166550 Aug 30 07:52:58.260095 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 471/897] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:58 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:59.276442 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bc361563-e758-4dd2-92f4-c2aca6c3138b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:52:59.277058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bc361563-e758-4dd2-92f4-c2aca6c3138b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:52:59.282745 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bc361563-e758-4dd2-92f4-c2aca6c3138b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:59.283186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bc361563-e758-4dd2-92f4-c2aca6c3138b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:59.283941 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bc361563-e758-4dd2-92f4-c2aca6c3138b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:52:59.284544 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bc361563-e758-4dd2-92f4-c2aca6c3138b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:52:59.408145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-bc361563-e758-4dd2-92f4-c2aca6c3138b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:52:59.416563 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bc361563-e758-4dd2-92f4-c2aca6c3138b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1720 microversion: 2.1 time: 0.144537 Aug 30 07:52:59.417127 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 472/898] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:52:59 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1720 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:52:59.673043 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5b61e503-2c35-4b27-9e59-3349a3bd9737 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 33243 microversion: 2.20 time: 3.159301 Aug 30 07:52:59.673997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 427/899] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:52:56 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 33243 bytes in 3161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:53:00.433528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9755706e-c839-4218-96a9-0398136ff81e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:00.434165 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9755706e-c839-4218-96a9-0398136ff81e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:00.440072 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9755706e-c839-4218-96a9-0398136ff81e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:00.440522 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9755706e-c839-4218-96a9-0398136ff81e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:00.441291 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9755706e-c839-4218-96a9-0398136ff81e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:00.441730 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9755706e-c839-4218-96a9-0398136ff81e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:00.562066 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9755706e-c839-4218-96a9-0398136ff81e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:00.570313 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9755706e-c839-4218-96a9-0398136ff81e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.141195 Aug 30 07:53:00.571124 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 473/900] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:00 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1697 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:00.588416 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-02719e43-1bdd-4398-9023-966de4237fab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:00.594795 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-02719e43-1bdd-4398-9023-966de4237fab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:00.595425 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-02719e43-1bdd-4398-9023-966de4237fab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:00.621457 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-02719e43-1bdd-4398-9023-966de4237fab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Going to try to start instance {{(pid=114670) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 30 07:53:00.668158 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-02719e43-1bdd-4398-9023-966de4237fab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 202 len: 0 microversion: 2.1 time: 0.084671 Aug 30 07:53:00.668855 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 428/901] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:53:00 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:53:00.681282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-40c2e551-4267-4ebe-8ef2-824bb6c58931 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:00.682418 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-40c2e551-4267-4ebe-8ef2-824bb6c58931 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:00.687354 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9529460b-8fc3-447f-8a88-669b2b718711 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:00.688964 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9529460b-8fc3-447f-8a88-669b2b718711 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:00.692648 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-40c2e551-4267-4ebe-8ef2-824bb6c58931 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:00.693451 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-40c2e551-4267-4ebe-8ef2-824bb6c58931 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:00.694686 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-40c2e551-4267-4ebe-8ef2-824bb6c58931 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:00.695133 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9529460b-8fc3-447f-8a88-669b2b718711 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:00.695635 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9529460b-8fc3-447f-8a88-669b2b718711 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:00.695965 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-40c2e551-4267-4ebe-8ef2-824bb6c58931 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:00.696470 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9529460b-8fc3-447f-8a88-669b2b718711 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:00.696946 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9529460b-8fc3-447f-8a88-669b2b718711 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:00.775385 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9529460b-8fc3-447f-8a88-669b2b718711 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 35548 microversion: 2.20 time: 0.092378 Aug 30 07:53:00.776042 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 429/902] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:53:00 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 35548 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:53:00.838721 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-40c2e551-4267-4ebe-8ef2-824bb6c58931 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:00.846390 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-40c2e551-4267-4ebe-8ef2-824bb6c58931 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1706 microversion: 2.1 time: 0.172147 Aug 30 07:53:00.846958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 474/903] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:00 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1706 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:01.020612 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1841706207", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "networks": [{"uuid": "8bbf986d-b800-482c-8c2d-425ae897d112"}]}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:01.075988 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] validate_networks() for [('8bbf986d-b800-482c-8c2d-425ae897d112', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:53:01.790506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-32c3dfd8-5374-4c93-811c-97b7465a04fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:01.792073 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-32c3dfd8-5374-4c93-811c-97b7465a04fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:01.798276 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32c3dfd8-5374-4c93-811c-97b7465a04fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:01.799008 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32c3dfd8-5374-4c93-811c-97b7465a04fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:01.800189 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32c3dfd8-5374-4c93-811c-97b7465a04fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:01.800844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32c3dfd8-5374-4c93-811c-97b7465a04fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:01.855564 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:53:01.856085 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:53:01.856436 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:53:01.857013 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:53:01.857427 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:53:01.869070 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:01.869903 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:01.871009 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:01.871744 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:01.886924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-32c3dfd8-5374-4c93-811c-97b7465a04fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 36875 microversion: 2.20 time: 0.101246 Aug 30 07:53:01.891265 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 475/904] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:53:01 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 36875 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:53:01.893542 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Getting quotas for project f802845196ae419e94d4aa18c6cb0344. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:53:01.896462 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5ccbd0f8-3445-49ba-9567-cc04542e5fc2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:01.897728 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5ccbd0f8-3445-49ba-9567-cc04542e5fc2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:01.901473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Getting quotas for user 40ec2ba0f5604cda983592b6036da5ac and project f802845196ae419e94d4aa18c6cb0344. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:53:01.905521 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ccbd0f8-3445-49ba-9567-cc04542e5fc2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:01.906214 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ccbd0f8-3445-49ba-9567-cc04542e5fc2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:01.907329 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ccbd0f8-3445-49ba-9567-cc04542e5fc2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:01.907988 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ccbd0f8-3445-49ba-9567-cc04542e5fc2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:01.915526 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:53:01.917950 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:53:01.977830 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a255c5e8-2ad7-44b9-8e1a-6fafdf25948c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961201 Aug 30 07:53:01.978945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 430/905] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:53:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:53:02.001181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-db937b5a-cb54-428a-a828-bf9f2d9e9c5f tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:02.003275 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-db937b5a-cb54-428a-a828-bf9f2d9e9c5f tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:02.081767 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-db937b5a-cb54-428a-a828-bf9f2d9e9c5f tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:02.089643 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-db937b5a-cb54-428a-a828-bf9f2d9e9c5f tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1219 microversion: 2.1 time: 0.095405 Aug 30 07:53:02.090554 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 431/906] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:01 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:02.121097 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5ccbd0f8-3445-49ba-9567-cc04542e5fc2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:02.130522 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5ccbd0f8-3445-49ba-9567-cc04542e5fc2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1706 microversion: 2.1 time: 0.237939 Aug 30 07:53:02.132034 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 476/907] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:01 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1706 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:02.898993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7e950812-7816-48ee-8fc1-c0a359541721 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:02.899884 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7e950812-7816-48ee-8fc1-c0a359541721 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:02.906725 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e950812-7816-48ee-8fc1-c0a359541721 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:02.907174 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e950812-7816-48ee-8fc1-c0a359541721 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:02.907934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e950812-7816-48ee-8fc1-c0a359541721 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:02.908366 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e950812-7816-48ee-8fc1-c0a359541721 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:02.987577 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7e950812-7816-48ee-8fc1-c0a359541721 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 38063 microversion: 2.20 time: 0.092455 Aug 30 07:53:02.988220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 432/908] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:53:02 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 38063 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:53:03.107179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-07a8ce43-ae28-4816-ad6b-d786afd2bc19 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:03.107793 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-07a8ce43-ae28-4816-ad6b-d786afd2bc19 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:03.124304 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07a8ce43-ae28-4816-ad6b-d786afd2bc19 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:03.124637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07a8ce43-ae28-4816-ad6b-d786afd2bc19 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:03.125490 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07a8ce43-ae28-4816-ad6b-d786afd2bc19 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:03.125972 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07a8ce43-ae28-4816-ad6b-d786afd2bc19 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:03.151250 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-127e0e8d-a149-4589-a9f0-9d9a2e0dc402 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:03.151886 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-127e0e8d-a149-4589-a9f0-9d9a2e0dc402 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:03.160721 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-127e0e8d-a149-4589-a9f0-9d9a2e0dc402 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:03.161556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-127e0e8d-a149-4589-a9f0-9d9a2e0dc402 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:03.164940 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-127e0e8d-a149-4589-a9f0-9d9a2e0dc402 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:03.165583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-127e0e8d-a149-4589-a9f0-9d9a2e0dc402 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:03.230731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-07a8ce43-ae28-4816-ad6b-d786afd2bc19 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:03.240218 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-07a8ce43-ae28-4816-ad6b-d786afd2bc19 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1279 microversion: 2.1 time: 0.136722 Aug 30 07:53:03.240811 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 477/909] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:03 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:03.455086 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-127e0e8d-a149-4589-a9f0-9d9a2e0dc402 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:03.463983 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-127e0e8d-a149-4589-a9f0-9d9a2e0dc402 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1710 microversion: 2.1 time: 0.317743 Aug 30 07:53:03.464620 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 433/910] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:03 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1710 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:04.000391 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1741de8c-28f0-4737-abe2-5a71c9666287 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:04.001286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1741de8c-28f0-4737-abe2-5a71c9666287 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:04.007112 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1741de8c-28f0-4737-abe2-5a71c9666287 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:04.008233 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1741de8c-28f0-4737-abe2-5a71c9666287 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:04.009027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1741de8c-28f0-4737-abe2-5a71c9666287 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:04.009459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1741de8c-28f0-4737-abe2-5a71c9666287 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:04.131301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1741de8c-28f0-4737-abe2-5a71c9666287 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 38197 microversion: 2.20 time: 0.134485 Aug 30 07:53:04.132016 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 478/911] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:53:03 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 38197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:53:04.258834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e9631d44-b942-4de2-88c5-c9d34791b1c7 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:04.259426 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e9631d44-b942-4de2-88c5-c9d34791b1c7 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:04.266020 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e9631d44-b942-4de2-88c5-c9d34791b1c7 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:04.266498 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e9631d44-b942-4de2-88c5-c9d34791b1c7 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:04.267279 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e9631d44-b942-4de2-88c5-c9d34791b1c7 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:04.268671 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e9631d44-b942-4de2-88c5-c9d34791b1c7 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:04.505974 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e9631d44-b942-4de2-88c5-c9d34791b1c7 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:04.516520 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e9631d44-b942-4de2-88c5-c9d34791b1c7 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.261672 Aug 30 07:53:04.517400 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 434/912] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:04 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:04.662720 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-3a0733c4-363f-4a05-8c42-f721e9a7c9d4 req-0ab86698-1482-4f96-bf32-60de88d84676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b8dae88-04c6-4417-b5ef-40ab8c78c7f3", "tag": "5e231977-0ba0-4d48-bc2c-cdbdab84ff26"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:04.666837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:53:04.666837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:53:04.674944 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-3a0733c4-363f-4a05-8c42-f721e9a7c9d4 req-0ab86698-1482-4f96-bf32-60de88d84676 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:04.675412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-3a0733c4-363f-4a05-8c42-f721e9a7c9d4 req-0ab86698-1482-4f96-bf32-60de88d84676 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:04.694460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-3a0733c4-363f-4a05-8c42-f721e9a7c9d4 req-0ab86698-1482-4f96-bf32-60de88d84676 service nova] Creating event network-changed:5e231977-0ba0-4d48-bc2c-cdbdab84ff26 for instance 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 on hv-cinder-80619 Aug 30 07:53:04.699433 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-3a0733c4-363f-4a05-8c42-f721e9a7c9d4 req-0ab86698-1482-4f96-bf32-60de88d84676 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040752 Aug 30 07:53:04.700025 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 479/913] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:53:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:53:05.144163 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ebf383e4-1934-41ac-9401-35eba2071f3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:05.145084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ebf383e4-1934-41ac-9401-35eba2071f3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:05.151921 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ebf383e4-1934-41ac-9401-35eba2071f3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:05.152402 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ebf383e4-1934-41ac-9401-35eba2071f3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:05.153173 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ebf383e4-1934-41ac-9401-35eba2071f3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:05.153608 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ebf383e4-1934-41ac-9401-35eba2071f3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:05.537652 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0cb94b15-3bbb-437b-b94e-d233dcdc6c7e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:05.539447 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0cb94b15-3bbb-437b-b94e-d233dcdc6c7e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:05.547904 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0cb94b15-3bbb-437b-b94e-d233dcdc6c7e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:05.548357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0cb94b15-3bbb-437b-b94e-d233dcdc6c7e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:05.549195 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0cb94b15-3bbb-437b-b94e-d233dcdc6c7e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:05.549704 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0cb94b15-3bbb-437b-b94e-d233dcdc6c7e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:05.576960 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ebf383e4-1934-41ac-9401-35eba2071f3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 38197 microversion: 2.20 time: 0.436368 Aug 30 07:53:05.578678 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 435/914] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:53:05 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 38197 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:53:05.690989 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0cb94b15-3bbb-437b-b94e-d233dcdc6c7e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:05.699058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0cb94b15-3bbb-437b-b94e-d233dcdc6c7e tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.168663 Aug 30 07:53:05.699624 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 480/915] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:05 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:53:06.590227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-00b8ab25-49f3-4389-adfc-74d4826835f4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:06.591232 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-00b8ab25-49f3-4389-adfc-74d4826835f4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:06.597646 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00b8ab25-49f3-4389-adfc-74d4826835f4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:06.598094 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00b8ab25-49f3-4389-adfc-74d4826835f4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:06.598883 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00b8ab25-49f3-4389-adfc-74d4826835f4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:06.599315 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-00b8ab25-49f3-4389-adfc-74d4826835f4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:06.665374 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-00b8ab25-49f3-4389-adfc-74d4826835f4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 38197 microversion: 2.20 time: 0.079146 Aug 30 07:53:06.666019 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 436/916] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:53:06 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 38197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:53:06.715655 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9d24cc7e-2e28-4452-9834-efce73e6fb68 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:06.716031 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9d24cc7e-2e28-4452-9834-efce73e6fb68 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:06.721687 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d24cc7e-2e28-4452-9834-efce73e6fb68 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:06.722123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d24cc7e-2e28-4452-9834-efce73e6fb68 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:06.722911 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d24cc7e-2e28-4452-9834-efce73e6fb68 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:06.723367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9d24cc7e-2e28-4452-9834-efce73e6fb68 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:06.855052 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9d24cc7e-2e28-4452-9834-efce73e6fb68 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:06.862178 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9d24cc7e-2e28-4452-9834-efce73e6fb68 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.150394 Aug 30 07:53:06.862752 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 481/917] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:06 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:07.677778 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-95a9c4dc-41b9-427b-8ddf-8d250a0dd0a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:07.678803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-95a9c4dc-41b9-427b-8ddf-8d250a0dd0a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:07.685298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-95a9c4dc-41b9-427b-8ddf-8d250a0dd0a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:07.685740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-95a9c4dc-41b9-427b-8ddf-8d250a0dd0a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:07.686539 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-95a9c4dc-41b9-427b-8ddf-8d250a0dd0a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:07.686975 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-95a9c4dc-41b9-427b-8ddf-8d250a0dd0a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:07.882640 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-805f5cf4-5b5c-48e3-97de-b5b869427616 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:07.883573 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-805f5cf4-5b5c-48e3-97de-b5b869427616 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:07.890357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-805f5cf4-5b5c-48e3-97de-b5b869427616 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:07.890811 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-805f5cf4-5b5c-48e3-97de-b5b869427616 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:07.891574 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-805f5cf4-5b5c-48e3-97de-b5b869427616 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:07.892000 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-805f5cf4-5b5c-48e3-97de-b5b869427616 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:08.017042 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-805f5cf4-5b5c-48e3-97de-b5b869427616 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:08.024816 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-805f5cf4-5b5c-48e3-97de-b5b869427616 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.148474 Aug 30 07:53:08.025413 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 482/918] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:07 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:09.040672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-17028f03-da40-4421-88eb-3290c3ba6848 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:09.041397 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-17028f03-da40-4421-88eb-3290c3ba6848 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:09.047011 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17028f03-da40-4421-88eb-3290c3ba6848 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:09.047459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17028f03-da40-4421-88eb-3290c3ba6848 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:09.048224 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17028f03-da40-4421-88eb-3290c3ba6848 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:09.048654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17028f03-da40-4421-88eb-3290c3ba6848 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:09.173700 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-17028f03-da40-4421-88eb-3290c3ba6848 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:09.181835 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-17028f03-da40-4421-88eb-3290c3ba6848 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.144810 Aug 30 07:53:09.182447 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 483/919] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:09 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:53:10.199506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bf1ae31a-1868-4166-bd31-6ee57ed7cb7a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:10.200143 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bf1ae31a-1868-4166-bd31-6ee57ed7cb7a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:10.205859 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf1ae31a-1868-4166-bd31-6ee57ed7cb7a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:10.206336 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf1ae31a-1868-4166-bd31-6ee57ed7cb7a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:10.207085 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf1ae31a-1868-4166-bd31-6ee57ed7cb7a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:10.207511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf1ae31a-1868-4166-bd31-6ee57ed7cb7a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:10.329167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-bf1ae31a-1868-4166-bd31-6ee57ed7cb7a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:10.336283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bf1ae31a-1868-4166-bd31-6ee57ed7cb7a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.140465 Aug 30 07:53:10.336843 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 484/920] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:10 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:53:11.353198 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ac8c02e1-eb1b-4a4d-98b8-a92be1a1d115 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:11.353808 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ac8c02e1-eb1b-4a4d-98b8-a92be1a1d115 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:11.359544 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ac8c02e1-eb1b-4a4d-98b8-a92be1a1d115 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:11.360057 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ac8c02e1-eb1b-4a4d-98b8-a92be1a1d115 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:11.360826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ac8c02e1-eb1b-4a4d-98b8-a92be1a1d115 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:11.361257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ac8c02e1-eb1b-4a4d-98b8-a92be1a1d115 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:11.486988 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ac8c02e1-eb1b-4a4d-98b8-a92be1a1d115 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:11.494391 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ac8c02e1-eb1b-4a4d-98b8-a92be1a1d115 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.145535 Aug 30 07:53:11.494966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 485/921] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:11 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:53:12.191546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-95a9c4dc-41b9-427b-8ddf-8d250a0dd0a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 200 len: 38338 microversion: 2.20 time: 4.517669 Aug 30 07:53:12.197146 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 437/922] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:53:07 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 38338 bytes in 4519 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:53:12.202322 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1987fd66-6414-46dd-837a-4ce99b021047 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:12.202829 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1987fd66-6414-46dd-837a-4ce99b021047 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:12.209286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1987fd66-6414-46dd-837a-4ce99b021047 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:12.209792 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1987fd66-6414-46dd-837a-4ce99b021047 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:12.210928 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1987fd66-6414-46dd-837a-4ce99b021047 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:12.211366 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1987fd66-6414-46dd-837a-4ce99b021047 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:12.235312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1987fd66-6414-46dd-837a-4ce99b021047 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/ips" status: 200 len: 151 microversion: 2.20 time: 0.036609 Aug 30 07:53:12.235794 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 486/923] 10.222.0.73 () {60 vars in 1289 bytes} [Mon Aug 30 07:53:12 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:53:12.511754 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-36ee6c68-cc83-4301-ad87-6b3eb4e08b99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:12.512460 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-36ee6c68-cc83-4301-ad87-6b3eb4e08b99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:12.519040 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-36ee6c68-cc83-4301-ad87-6b3eb4e08b99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:12.519490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-36ee6c68-cc83-4301-ad87-6b3eb4e08b99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:12.520259 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-36ee6c68-cc83-4301-ad87-6b3eb4e08b99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:12.520695 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-36ee6c68-cc83-4301-ad87-6b3eb4e08b99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:12.651510 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-36ee6c68-cc83-4301-ad87-6b3eb4e08b99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:12.658871 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-36ee6c68-cc83-4301-ad87-6b3eb4e08b99 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.151094 Aug 30 07:53:12.659439 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 438/924] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:12 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:13.677160 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5ecf7b4a-5c55-4d1d-a372-80e58facd7d8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:13.677768 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5ecf7b4a-5c55-4d1d-a372-80e58facd7d8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:13.684447 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ecf7b4a-5c55-4d1d-a372-80e58facd7d8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:13.684637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ecf7b4a-5c55-4d1d-a372-80e58facd7d8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:13.685365 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ecf7b4a-5c55-4d1d-a372-80e58facd7d8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:13.685795 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ecf7b4a-5c55-4d1d-a372-80e58facd7d8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:13.802055 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5ecf7b4a-5c55-4d1d-a372-80e58facd7d8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:13.810194 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5ecf7b4a-5c55-4d1d-a372-80e58facd7d8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.136690 Aug 30 07:53:13.810826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 487/925] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:13 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:14.826284 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f421d38e-c9a1-4e18-9ab9-d5f596f07d05 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:14.826948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f421d38e-c9a1-4e18-9ab9-d5f596f07d05 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:14.833143 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f421d38e-c9a1-4e18-9ab9-d5f596f07d05 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:14.833590 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f421d38e-c9a1-4e18-9ab9-d5f596f07d05 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:14.834523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f421d38e-c9a1-4e18-9ab9-d5f596f07d05 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:14.834981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f421d38e-c9a1-4e18-9ab9-d5f596f07d05 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:14.954367 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f421d38e-c9a1-4e18-9ab9-d5f596f07d05 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:14.961646 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f421d38e-c9a1-4e18-9ab9-d5f596f07d05 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.138984 Aug 30 07:53:14.962234 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 439/926] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:14 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:15.978536 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-02b3e3eb-4f25-42b4-b22c-c8503fe42639 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:15.979150 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-02b3e3eb-4f25-42b4-b22c-c8503fe42639 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:15.984972 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-02b3e3eb-4f25-42b4-b22c-c8503fe42639 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:15.985409 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-02b3e3eb-4f25-42b4-b22c-c8503fe42639 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:15.986180 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-02b3e3eb-4f25-42b4-b22c-c8503fe42639 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:15.986613 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-02b3e3eb-4f25-42b4-b22c-c8503fe42639 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:16.105831 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-02b3e3eb-4f25-42b4-b22c-c8503fe42639 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:16.113068 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-02b3e3eb-4f25-42b4-b22c-c8503fe42639 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.138206 Aug 30 07:53:16.113682 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 488/927] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:15 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:17.130225 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-761cbe18-dfe8-446f-894a-1a51008d7812 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:17.130831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-761cbe18-dfe8-446f-894a-1a51008d7812 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:17.136981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-761cbe18-dfe8-446f-894a-1a51008d7812 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:17.137456 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-761cbe18-dfe8-446f-894a-1a51008d7812 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:17.138299 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-761cbe18-dfe8-446f-894a-1a51008d7812 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:17.138729 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-761cbe18-dfe8-446f-894a-1a51008d7812 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:17.256323 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-761cbe18-dfe8-446f-894a-1a51008d7812 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:17.263508 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-761cbe18-dfe8-446f-894a-1a51008d7812 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.137034 Aug 30 07:53:17.264068 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 440/928] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:17 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:18.282114 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9e10cd7f-5534-42cd-9f6e-a1d6a6396e61 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:18.282684 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9e10cd7f-5534-42cd-9f6e-a1d6a6396e61 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:18.292933 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9e10cd7f-5534-42cd-9f6e-a1d6a6396e61 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:18.293375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9e10cd7f-5534-42cd-9f6e-a1d6a6396e61 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:18.294137 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9e10cd7f-5534-42cd-9f6e-a1d6a6396e61 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:18.294603 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9e10cd7f-5534-42cd-9f6e-a1d6a6396e61 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:18.416195 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9e10cd7f-5534-42cd-9f6e-a1d6a6396e61 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:18.423375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9e10cd7f-5534-42cd-9f6e-a1d6a6396e61 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.145242 Aug 30 07:53:18.423926 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 489/929] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:18 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:19.440709 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b01a97fe-bbe2-4a9f-bead-8672237064a5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:19.441412 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b01a97fe-bbe2-4a9f-bead-8672237064a5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:19.447829 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b01a97fe-bbe2-4a9f-bead-8672237064a5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:19.448269 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b01a97fe-bbe2-4a9f-bead-8672237064a5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:19.449022 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b01a97fe-bbe2-4a9f-bead-8672237064a5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:19.449450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b01a97fe-bbe2-4a9f-bead-8672237064a5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:19.569529 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b01a97fe-bbe2-4a9f-bead-8672237064a5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:19.576735 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b01a97fe-bbe2-4a9f-bead-8672237064a5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.139747 Aug 30 07:53:19.577302 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 441/930] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:19 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:20.585404 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-54478c17-cc44-482c-a950-44f40851bc29 req-2d9bebf8-6f50-41b5-a3c5-5240e3f3ad96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b8dae88-04c6-4417-b5ef-40ab8c78c7f3", "name": "network-vif-plugged", "status": "completed", "tag": "5e231977-0ba0-4d48-bc2c-cdbdab84ff26"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:20.587460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:53:20.587460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:53:20.594921 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d9eabc04-231a-4bc0-bdd8-b15fa50f4dc0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:20.595645 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d9eabc04-231a-4bc0-bdd8-b15fa50f4dc0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:20.595832 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-54478c17-cc44-482c-a950-44f40851bc29 req-2d9bebf8-6f50-41b5-a3c5-5240e3f3ad96 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:20.596366 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-54478c17-cc44-482c-a950-44f40851bc29 req-2d9bebf8-6f50-41b5-a3c5-5240e3f3ad96 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:20.601750 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9eabc04-231a-4bc0-bdd8-b15fa50f4dc0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:20.602210 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9eabc04-231a-4bc0-bdd8-b15fa50f4dc0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:20.602980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9eabc04-231a-4bc0-bdd8-b15fa50f4dc0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:20.603592 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d9eabc04-231a-4bc0-bdd8-b15fa50f4dc0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:20.608768 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-54478c17-cc44-482c-a950-44f40851bc29 req-2d9bebf8-6f50-41b5-a3c5-5240e3f3ad96 service nova] Creating event network-vif-plugged:5e231977-0ba0-4d48-bc2c-cdbdab84ff26 for instance 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 on hv-cinder-80619 Aug 30 07:53:20.613962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-54478c17-cc44-482c-a950-44f40851bc29 req-2d9bebf8-6f50-41b5-a3c5-5240e3f3ad96 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033288 Aug 30 07:53:20.615093 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 490/931] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:53:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:53:20.728796 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d9eabc04-231a-4bc0-bdd8-b15fa50f4dc0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:20.735905 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d9eabc04-231a-4bc0-bdd8-b15fa50f4dc0 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.144872 Aug 30 07:53:20.736492 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 442/932] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:20 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:21.753848 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-39cd61e4-7825-49ae-9b60-cdc3534d9e3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:21.754561 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-39cd61e4-7825-49ae-9b60-cdc3534d9e3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:21.760767 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-39cd61e4-7825-49ae-9b60-cdc3534d9e3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:21.761208 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-39cd61e4-7825-49ae-9b60-cdc3534d9e3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:21.761957 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-39cd61e4-7825-49ae-9b60-cdc3534d9e3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:21.762414 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-39cd61e4-7825-49ae-9b60-cdc3534d9e3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:21.883739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-39cd61e4-7825-49ae-9b60-cdc3534d9e3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:21.891220 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-39cd61e4-7825-49ae-9b60-cdc3534d9e3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.141114 Aug 30 07:53:21.891781 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 491/933] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:21 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:22.908171 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7f57046f-a549-4291-84fb-82e94f38131c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:22.908789 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7f57046f-a549-4291-84fb-82e94f38131c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:22.915549 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f57046f-a549-4291-84fb-82e94f38131c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:22.915996 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f57046f-a549-4291-84fb-82e94f38131c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:22.916792 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f57046f-a549-4291-84fb-82e94f38131c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:22.917231 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7f57046f-a549-4291-84fb-82e94f38131c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:23.036828 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7f57046f-a549-4291-84fb-82e94f38131c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:23.044061 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7f57046f-a549-4291-84fb-82e94f38131c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.139509 Aug 30 07:53:23.044629 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 443/934] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:22 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:53:23.652782 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e221206f-6168-4a94-bdf0-4c8d68de68a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:23.653367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e221206f-6168-4a94-bdf0-4c8d68de68a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:23.659293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e221206f-6168-4a94-bdf0-4c8d68de68a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:23.659743 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e221206f-6168-4a94-bdf0-4c8d68de68a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:23.660515 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e221206f-6168-4a94-bdf0-4c8d68de68a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:23.660951 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e221206f-6168-4a94-bdf0-4c8d68de68a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:23.685131 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-e221206f-6168-4a94-bdf0-4c8d68de68a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lazy-loading 'flavor' on Instance uuid 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:53:23.941139 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e221206f-6168-4a94-bdf0-4c8d68de68a2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 202 len: 0 microversion: 2.20 time: 0.292004 Aug 30 07:53:23.941863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 492/935] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:53:23 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:53:23.951173 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2381f762-4b88-4980-ac4c-4615b3ece6af tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:23.951831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2381f762-4b88-4980-ac4c-4615b3ece6af tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:23.958132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2381f762-4b88-4980-ac4c-4615b3ece6af tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:23.958698 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2381f762-4b88-4980-ac4c-4615b3ece6af tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:23.961124 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2381f762-4b88-4980-ac4c-4615b3ece6af tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:23.961769 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2381f762-4b88-4980-ac4c-4615b3ece6af tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:24.061387 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1e45c0d9-b3ed-4cdc-9040-d2b4d2acbc3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:24.062091 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1e45c0d9-b3ed-4cdc-9040-d2b4d2acbc3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:24.068383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e45c0d9-b3ed-4cdc-9040-d2b4d2acbc3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:24.068845 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e45c0d9-b3ed-4cdc-9040-d2b4d2acbc3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:24.070401 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e45c0d9-b3ed-4cdc-9040-d2b4d2acbc3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:24.070573 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e45c0d9-b3ed-4cdc-9040-d2b4d2acbc3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:24.092945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2381f762-4b88-4980-ac4c-4615b3ece6af tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:24.101153 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2381f762-4b88-4980-ac4c-4615b3ece6af tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:24.102673 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2381f762-4b88-4980-ac4c-4615b3ece6af tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:24.103810 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2381f762-4b88-4980-ac4c-4615b3ece6af tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.157710 Aug 30 07:53:24.104362 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 444/936] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:23 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:24.200853 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1e45c0d9-b3ed-4cdc-9040-d2b4d2acbc3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:24.210563 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1e45c0d9-b3ed-4cdc-9040-d2b4d2acbc3c tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.153116 Aug 30 07:53:24.211136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 493/937] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:24 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:53:25.122193 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7cd53a10-a310-4612-836e-b747b01410d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:25.122845 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7cd53a10-a310-4612-836e-b747b01410d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:25.128694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7cd53a10-a310-4612-836e-b747b01410d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:25.129351 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7cd53a10-a310-4612-836e-b747b01410d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:25.129948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7cd53a10-a310-4612-836e-b747b01410d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:25.130410 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7cd53a10-a310-4612-836e-b747b01410d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:25.227465 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0763856e-b911-41f8-9abe-ad89a13036af tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:25.228088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0763856e-b911-41f8-9abe-ad89a13036af tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:25.245757 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0763856e-b911-41f8-9abe-ad89a13036af tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:25.246294 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0763856e-b911-41f8-9abe-ad89a13036af tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:25.247102 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0763856e-b911-41f8-9abe-ad89a13036af tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:25.247678 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0763856e-b911-41f8-9abe-ad89a13036af tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:25.266713 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7cd53a10-a310-4612-836e-b747b01410d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:25.277479 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7cd53a10-a310-4612-836e-b747b01410d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:25.280599 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7cd53a10-a310-4612-836e-b747b01410d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:25.282773 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7cd53a10-a310-4612-836e-b747b01410d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.164220 Aug 30 07:53:25.305772 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 445/938] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:25 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:25.404163 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0763856e-b911-41f8-9abe-ad89a13036af tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:25.411615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0763856e-b911-41f8-9abe-ad89a13036af tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1319 microversion: 2.1 time: 0.188267 Aug 30 07:53:25.412791 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 494/939] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:25 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:53:26.302091 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8cc0a6e1-c9f2-4823-96e0-6bdd6e656596 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:26.303391 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8cc0a6e1-c9f2-4823-96e0-6bdd6e656596 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:26.309215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8cc0a6e1-c9f2-4823-96e0-6bdd6e656596 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:26.309660 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8cc0a6e1-c9f2-4823-96e0-6bdd6e656596 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:26.310458 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8cc0a6e1-c9f2-4823-96e0-6bdd6e656596 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:26.310894 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8cc0a6e1-c9f2-4823-96e0-6bdd6e656596 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:26.430969 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-40c21555-6a65-4a1e-894d-859f071ddab1 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:26.431521 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-40c21555-6a65-4a1e-894d-859f071ddab1 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:26.436305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8cc0a6e1-c9f2-4823-96e0-6bdd6e656596 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:26.437605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-40c21555-6a65-4a1e-894d-859f071ddab1 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:26.438060 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-40c21555-6a65-4a1e-894d-859f071ddab1 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:26.438863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-40c21555-6a65-4a1e-894d-859f071ddab1 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:26.439287 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-40c21555-6a65-4a1e-894d-859f071ddab1 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:26.444474 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8cc0a6e1-c9f2-4823-96e0-6bdd6e656596 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:26.445972 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8cc0a6e1-c9f2-4823-96e0-6bdd6e656596 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:26.447474 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8cc0a6e1-c9f2-4823-96e0-6bdd6e656596 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.149193 Aug 30 07:53:26.448154 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 446/940] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:26 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:26.566528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-40c21555-6a65-4a1e-894d-859f071ddab1 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:26.574481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-40c21555-6a65-4a1e-894d-859f071ddab1 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1508 microversion: 2.1 time: 0.148674 Aug 30 07:53:26.575055 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 495/941] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:26 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:53:26.602533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fcc6078f-fb5f-4437-838a-5a194e8fbdc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2464415-9f9b-4156-8ecf-59766ddba9f4", "device": "/dev/sdb"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:53:26.604165 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fcc6078f-fb5f-4437-838a-5a194e8fbdc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:26.609901 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fcc6078f-fb5f-4437-838a-5a194e8fbdc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:26.610384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fcc6078f-fb5f-4437-838a-5a194e8fbdc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:26.611155 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fcc6078f-fb5f-4437-838a-5a194e8fbdc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:26.611586 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fcc6078f-fb5f-4437-838a-5a194e8fbdc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:26.856100 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fcc6078f-fb5f-4437-838a-5a194e8fbdc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "POST /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267924 Aug 30 07:53:26.856707 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 447/942] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:53:26 2021] POST /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:53:27.470194 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e6fe8d63-bf72-44fd-bbbd-9cf33fb9875e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:27.470927 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e6fe8d63-bf72-44fd-bbbd-9cf33fb9875e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:27.477798 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6fe8d63-bf72-44fd-bbbd-9cf33fb9875e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:27.478591 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6fe8d63-bf72-44fd-bbbd-9cf33fb9875e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:27.479555 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6fe8d63-bf72-44fd-bbbd-9cf33fb9875e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:27.480058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6fe8d63-bf72-44fd-bbbd-9cf33fb9875e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:27.605643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e6fe8d63-bf72-44fd-bbbd-9cf33fb9875e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:27.613355 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e6fe8d63-bf72-44fd-bbbd-9cf33fb9875e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:27.614901 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e6fe8d63-bf72-44fd-bbbd-9cf33fb9875e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:27.616127 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e6fe8d63-bf72-44fd-bbbd-9cf33fb9875e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.154025 Aug 30 07:53:27.616693 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 496/943] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:27 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:28.635966 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fb2324ac-aa85-41a8-9fea-8b37dd8bee4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:28.636656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fb2324ac-aa85-41a8-9fea-8b37dd8bee4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:28.643435 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fb2324ac-aa85-41a8-9fea-8b37dd8bee4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:28.643877 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fb2324ac-aa85-41a8-9fea-8b37dd8bee4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:28.644638 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fb2324ac-aa85-41a8-9fea-8b37dd8bee4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:28.645069 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fb2324ac-aa85-41a8-9fea-8b37dd8bee4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:28.774113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-fb2324ac-aa85-41a8-9fea-8b37dd8bee4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:28.783630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-fb2324ac-aa85-41a8-9fea-8b37dd8bee4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:28.785353 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-fb2324ac-aa85-41a8-9fea-8b37dd8bee4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:28.786689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fb2324ac-aa85-41a8-9fea-8b37dd8bee4f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.155725 Aug 30 07:53:28.787549 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 448/944] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:28 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:29.807195 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d69f5803-7657-4259-b98f-1179a6a85040 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:29.807757 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d69f5803-7657-4259-b98f-1179a6a85040 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:29.813876 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d69f5803-7657-4259-b98f-1179a6a85040 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:29.814370 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d69f5803-7657-4259-b98f-1179a6a85040 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:29.815145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d69f5803-7657-4259-b98f-1179a6a85040 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:29.815579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d69f5803-7657-4259-b98f-1179a6a85040 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:29.943116 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d69f5803-7657-4259-b98f-1179a6a85040 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:29.952115 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d69f5803-7657-4259-b98f-1179a6a85040 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:29.953609 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d69f5803-7657-4259-b98f-1179a6a85040 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:29.954791 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d69f5803-7657-4259-b98f-1179a6a85040 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.152550 Aug 30 07:53:29.955341 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 497/945] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:29 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:30.972439 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cca2cba3-98f7-47af-8ac8-22cf13edfa0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:30.973047 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-cca2cba3-98f7-47af-8ac8-22cf13edfa0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:30.979760 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cca2cba3-98f7-47af-8ac8-22cf13edfa0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:30.980204 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cca2cba3-98f7-47af-8ac8-22cf13edfa0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:30.980993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cca2cba3-98f7-47af-8ac8-22cf13edfa0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:30.981418 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cca2cba3-98f7-47af-8ac8-22cf13edfa0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:31.103772 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-cca2cba3-98f7-47af-8ac8-22cf13edfa0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:31.111569 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-cca2cba3-98f7-47af-8ac8-22cf13edfa0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:31.113072 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-cca2cba3-98f7-47af-8ac8-22cf13edfa0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:31.114223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-cca2cba3-98f7-47af-8ac8-22cf13edfa0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.145443 Aug 30 07:53:31.114774 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 449/946] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:30 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:32.132880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-809757f7-f930-4e8c-ac44-830f5bf9a02f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:32.133493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-809757f7-f930-4e8c-ac44-830f5bf9a02f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:32.139438 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-809757f7-f930-4e8c-ac44-830f5bf9a02f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:32.139883 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-809757f7-f930-4e8c-ac44-830f5bf9a02f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:32.140643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-809757f7-f930-4e8c-ac44-830f5bf9a02f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:32.141076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-809757f7-f930-4e8c-ac44-830f5bf9a02f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:32.265412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-809757f7-f930-4e8c-ac44-830f5bf9a02f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:32.273602 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-809757f7-f930-4e8c-ac44-830f5bf9a02f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:32.275118 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-809757f7-f930-4e8c-ac44-830f5bf9a02f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:32.276256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-809757f7-f930-4e8c-ac44-830f5bf9a02f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.147384 Aug 30 07:53:32.276799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 498/947] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:32 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:33.294284 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-444c6ad7-b0aa-44c0-ad49-a0bdbe57cc99 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:33.294873 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-444c6ad7-b0aa-44c0-ad49-a0bdbe57cc99 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:33.300628 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-444c6ad7-b0aa-44c0-ad49-a0bdbe57cc99 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:33.301068 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-444c6ad7-b0aa-44c0-ad49-a0bdbe57cc99 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:33.301818 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-444c6ad7-b0aa-44c0-ad49-a0bdbe57cc99 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:33.302278 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-444c6ad7-b0aa-44c0-ad49-a0bdbe57cc99 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:33.426612 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-444c6ad7-b0aa-44c0-ad49-a0bdbe57cc99 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:33.436682 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-444c6ad7-b0aa-44c0-ad49-a0bdbe57cc99 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:33.438254 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-444c6ad7-b0aa-44c0-ad49-a0bdbe57cc99 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:33.439521 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-444c6ad7-b0aa-44c0-ad49-a0bdbe57cc99 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.148797 Aug 30 07:53:33.440253 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 450/948] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:33 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:34.456620 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c41841e7-67e7-4022-ab8d-523d4464e545 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:34.457211 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c41841e7-67e7-4022-ab8d-523d4464e545 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:34.462995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c41841e7-67e7-4022-ab8d-523d4464e545 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:34.463433 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c41841e7-67e7-4022-ab8d-523d4464e545 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:34.464183 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c41841e7-67e7-4022-ab8d-523d4464e545 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:34.464606 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c41841e7-67e7-4022-ab8d-523d4464e545 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:34.588369 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c41841e7-67e7-4022-ab8d-523d4464e545 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:34.596288 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c41841e7-67e7-4022-ab8d-523d4464e545 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:34.597830 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c41841e7-67e7-4022-ab8d-523d4464e545 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:34.599006 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c41841e7-67e7-4022-ab8d-523d4464e545 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.146128 Aug 30 07:53:34.599559 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 499/949] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:34 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:35.617194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-21d03788-4509-406b-b9d2-dea678c63672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:35.617832 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-21d03788-4509-406b-b9d2-dea678c63672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:35.624025 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21d03788-4509-406b-b9d2-dea678c63672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:35.624474 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21d03788-4509-406b-b9d2-dea678c63672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:35.625239 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21d03788-4509-406b-b9d2-dea678c63672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:35.625673 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21d03788-4509-406b-b9d2-dea678c63672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:35.749021 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-21d03788-4509-406b-b9d2-dea678c63672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:35.757803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-21d03788-4509-406b-b9d2-dea678c63672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:35.759703 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-21d03788-4509-406b-b9d2-dea678c63672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:35.760836 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-21d03788-4509-406b-b9d2-dea678c63672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.148075 Aug 30 07:53:35.761390 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 451/950] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:35 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:36.778567 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b181af4a-41ce-4165-b747-057b9a1864ca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:36.779179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b181af4a-41ce-4165-b747-057b9a1864ca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:36.785378 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b181af4a-41ce-4165-b747-057b9a1864ca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:36.785826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b181af4a-41ce-4165-b747-057b9a1864ca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:36.786621 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b181af4a-41ce-4165-b747-057b9a1864ca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:36.787058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b181af4a-41ce-4165-b747-057b9a1864ca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:37.171182 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b181af4a-41ce-4165-b747-057b9a1864ca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:37.179530 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b181af4a-41ce-4165-b747-057b9a1864ca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:37.181017 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b181af4a-41ce-4165-b747-057b9a1864ca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:37.182227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b181af4a-41ce-4165-b747-057b9a1864ca tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.407337 Aug 30 07:53:37.182724 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 500/951] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:36 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:38.201001 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a0083055-b820-4a94-8177-3ac9bffbe2d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:38.201712 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a0083055-b820-4a94-8177-3ac9bffbe2d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:38.207554 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a0083055-b820-4a94-8177-3ac9bffbe2d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:38.207996 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a0083055-b820-4a94-8177-3ac9bffbe2d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:38.208750 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a0083055-b820-4a94-8177-3ac9bffbe2d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:38.209219 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a0083055-b820-4a94-8177-3ac9bffbe2d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:38.330840 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a0083055-b820-4a94-8177-3ac9bffbe2d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:38.339131 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a0083055-b820-4a94-8177-3ac9bffbe2d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:38.340648 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a0083055-b820-4a94-8177-3ac9bffbe2d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:38.341790 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a0083055-b820-4a94-8177-3ac9bffbe2d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.144530 Aug 30 07:53:38.342387 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 452/952] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:38 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:39.359426 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f88a83ec-31f3-453a-9c15-d77a9fada29b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:39.360039 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f88a83ec-31f3-453a-9c15-d77a9fada29b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:39.367209 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f88a83ec-31f3-453a-9c15-d77a9fada29b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:39.367658 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f88a83ec-31f3-453a-9c15-d77a9fada29b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:39.368428 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f88a83ec-31f3-453a-9c15-d77a9fada29b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:39.368867 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f88a83ec-31f3-453a-9c15-d77a9fada29b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:39.486882 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f88a83ec-31f3-453a-9c15-d77a9fada29b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:39.497552 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f88a83ec-31f3-453a-9c15-d77a9fada29b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:39.499067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f88a83ec-31f3-453a-9c15-d77a9fada29b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:39.500208 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f88a83ec-31f3-453a-9c15-d77a9fada29b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.144499 Aug 30 07:53:39.500763 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 501/953] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:39 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:40.518654 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3f5d6997-3bb6-4de6-a3b0-b318b48e9446 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:40.519265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3f5d6997-3bb6-4de6-a3b0-b318b48e9446 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:40.525230 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3f5d6997-3bb6-4de6-a3b0-b318b48e9446 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:40.525674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3f5d6997-3bb6-4de6-a3b0-b318b48e9446 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:40.526498 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3f5d6997-3bb6-4de6-a3b0-b318b48e9446 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:40.526945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3f5d6997-3bb6-4de6-a3b0-b318b48e9446 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:40.649627 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3f5d6997-3bb6-4de6-a3b0-b318b48e9446 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:40.657455 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3f5d6997-3bb6-4de6-a3b0-b318b48e9446 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:40.659077 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3f5d6997-3bb6-4de6-a3b0-b318b48e9446 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:40.660200 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3f5d6997-3bb6-4de6-a3b0-b318b48e9446 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.145252 Aug 30 07:53:40.660753 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 453/954] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:40 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:41.679339 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-afd5e985-6a44-42f4-a4db-4c5fa620cedb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:41.679985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-afd5e985-6a44-42f4-a4db-4c5fa620cedb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:41.686994 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-afd5e985-6a44-42f4-a4db-4c5fa620cedb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:41.687441 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-afd5e985-6a44-42f4-a4db-4c5fa620cedb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:41.688195 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-afd5e985-6a44-42f4-a4db-4c5fa620cedb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:41.688629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-afd5e985-6a44-42f4-a4db-4c5fa620cedb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:41.808341 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-afd5e985-6a44-42f4-a4db-4c5fa620cedb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:41.816144 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-afd5e985-6a44-42f4-a4db-4c5fa620cedb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:41.817648 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-afd5e985-6a44-42f4-a4db-4c5fa620cedb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:41.818811 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-afd5e985-6a44-42f4-a4db-4c5fa620cedb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.143366 Aug 30 07:53:41.819380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 502/955] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:41 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:42.836991 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-03bc03a4-cbb4-4174-b288-48d4a1e1824a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:42.837594 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-03bc03a4-cbb4-4174-b288-48d4a1e1824a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:42.843530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-03bc03a4-cbb4-4174-b288-48d4a1e1824a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:42.843973 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-03bc03a4-cbb4-4174-b288-48d4a1e1824a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:42.844728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-03bc03a4-cbb4-4174-b288-48d4a1e1824a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:42.845161 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-03bc03a4-cbb4-4174-b288-48d4a1e1824a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:42.968860 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-03bc03a4-cbb4-4174-b288-48d4a1e1824a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:42.976338 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-03bc03a4-cbb4-4174-b288-48d4a1e1824a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:42.977969 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-03bc03a4-cbb4-4174-b288-48d4a1e1824a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:42.979145 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-03bc03a4-cbb4-4174-b288-48d4a1e1824a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.146399 Aug 30 07:53:42.979694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 454/956] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:42 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:43.997445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ee8f1407-442c-49dc-9335-c9b0a099bb4c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:43.998058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ee8f1407-442c-49dc-9335-c9b0a099bb4c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:44.003889 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ee8f1407-442c-49dc-9335-c9b0a099bb4c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:44.004330 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ee8f1407-442c-49dc-9335-c9b0a099bb4c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:44.005086 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ee8f1407-442c-49dc-9335-c9b0a099bb4c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:44.005520 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ee8f1407-442c-49dc-9335-c9b0a099bb4c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:44.133583 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ee8f1407-442c-49dc-9335-c9b0a099bb4c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:44.141394 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ee8f1407-442c-49dc-9335-c9b0a099bb4c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:44.142931 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ee8f1407-442c-49dc-9335-c9b0a099bb4c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:44.144067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ee8f1407-442c-49dc-9335-c9b0a099bb4c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.150388 Aug 30 07:53:44.144620 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 503/957] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:43 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:53:45.162702 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f6b46981-98eb-4ced-9474-6c1364398fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:45.163326 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f6b46981-98eb-4ced-9474-6c1364398fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:45.169739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6b46981-98eb-4ced-9474-6c1364398fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:45.170290 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6b46981-98eb-4ced-9474-6c1364398fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:45.171057 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6b46981-98eb-4ced-9474-6c1364398fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:45.171489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6b46981-98eb-4ced-9474-6c1364398fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:45.294453 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f6b46981-98eb-4ced-9474-6c1364398fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:45.302209 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f6b46981-98eb-4ced-9474-6c1364398fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:45.303690 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f6b46981-98eb-4ced-9474-6c1364398fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:45.305338 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f6b46981-98eb-4ced-9474-6c1364398fbb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.146365 Aug 30 07:53:45.305914 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 455/958] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:45 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:46.323097 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7b035c63-bab7-4d00-86ac-0c3cce1d618e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:46.323704 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7b035c63-bab7-4d00-86ac-0c3cce1d618e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:46.329594 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b035c63-bab7-4d00-86ac-0c3cce1d618e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:46.330033 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b035c63-bab7-4d00-86ac-0c3cce1d618e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:46.330817 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b035c63-bab7-4d00-86ac-0c3cce1d618e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:46.331244 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b035c63-bab7-4d00-86ac-0c3cce1d618e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:46.456893 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7b035c63-bab7-4d00-86ac-0c3cce1d618e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:46.466612 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7b035c63-bab7-4d00-86ac-0c3cce1d618e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:46.468158 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7b035c63-bab7-4d00-86ac-0c3cce1d618e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:46.469312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7b035c63-bab7-4d00-86ac-0c3cce1d618e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.149963 Aug 30 07:53:46.469880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 504/959] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:46 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:53:47.487958 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-49552c4a-d1ed-4cba-ac8f-94daad1f4408 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:47.488672 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-49552c4a-d1ed-4cba-ac8f-94daad1f4408 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:47.495998 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49552c4a-d1ed-4cba-ac8f-94daad1f4408 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:47.496743 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49552c4a-d1ed-4cba-ac8f-94daad1f4408 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:47.497694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49552c4a-d1ed-4cba-ac8f-94daad1f4408 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:47.498133 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-49552c4a-d1ed-4cba-ac8f-94daad1f4408 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:47.641544 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-49552c4a-d1ed-4cba-ac8f-94daad1f4408 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:47.649798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-49552c4a-d1ed-4cba-ac8f-94daad1f4408 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:47.651363 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-49552c4a-d1ed-4cba-ac8f-94daad1f4408 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:47.652523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-49552c4a-d1ed-4cba-ac8f-94daad1f4408 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.168220 Aug 30 07:53:47.653080 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 456/960] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:47 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:48.671310 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bf100a73-a869-4c46-82a7-31b2b79e02b4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:48.672036 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bf100a73-a869-4c46-82a7-31b2b79e02b4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:48.677819 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf100a73-a869-4c46-82a7-31b2b79e02b4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:48.678383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf100a73-a869-4c46-82a7-31b2b79e02b4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:48.679215 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf100a73-a869-4c46-82a7-31b2b79e02b4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:48.679732 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bf100a73-a869-4c46-82a7-31b2b79e02b4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:48.830576 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-bf100a73-a869-4c46-82a7-31b2b79e02b4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:48.839343 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-bf100a73-a869-4c46-82a7-31b2b79e02b4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:48.840912 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-bf100a73-a869-4c46-82a7-31b2b79e02b4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:48.842060 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bf100a73-a869-4c46-82a7-31b2b79e02b4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.174544 Aug 30 07:53:48.853159 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 505/961] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:48 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:49.860565 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c2461e9b-b608-48a2-8186-c9d2db5b2349 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:49.861176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c2461e9b-b608-48a2-8186-c9d2db5b2349 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:49.867160 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c2461e9b-b608-48a2-8186-c9d2db5b2349 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:49.868297 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c2461e9b-b608-48a2-8186-c9d2db5b2349 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:49.869085 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c2461e9b-b608-48a2-8186-c9d2db5b2349 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:49.869600 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c2461e9b-b608-48a2-8186-c9d2db5b2349 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:50.002793 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c2461e9b-b608-48a2-8186-c9d2db5b2349 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:50.011401 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c2461e9b-b608-48a2-8186-c9d2db5b2349 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:50.013014 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c2461e9b-b608-48a2-8186-c9d2db5b2349 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:50.014189 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c2461e9b-b608-48a2-8186-c9d2db5b2349 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.157368 Aug 30 07:53:50.014749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 457/962] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:49 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:51.034567 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8da71f8b-7dcb-484b-84d3-9be4de5df98a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:51.035429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8da71f8b-7dcb-484b-84d3-9be4de5df98a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:51.044436 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8da71f8b-7dcb-484b-84d3-9be4de5df98a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:51.044882 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8da71f8b-7dcb-484b-84d3-9be4de5df98a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:51.045811 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8da71f8b-7dcb-484b-84d3-9be4de5df98a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:51.046275 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8da71f8b-7dcb-484b-84d3-9be4de5df98a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:51.170724 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8da71f8b-7dcb-484b-84d3-9be4de5df98a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:51.179012 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8da71f8b-7dcb-484b-84d3-9be4de5df98a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:51.181240 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8da71f8b-7dcb-484b-84d3-9be4de5df98a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:51.182471 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8da71f8b-7dcb-484b-84d3-9be4de5df98a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.151595 Aug 30 07:53:51.183082 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 506/963] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:51 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:52.201865 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-50a9134c-101c-444c-a2dd-582847b82848 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:52.202510 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-50a9134c-101c-444c-a2dd-582847b82848 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:52.208325 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-50a9134c-101c-444c-a2dd-582847b82848 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:52.208777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-50a9134c-101c-444c-a2dd-582847b82848 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:52.209594 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-50a9134c-101c-444c-a2dd-582847b82848 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:52.210032 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-50a9134c-101c-444c-a2dd-582847b82848 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:52.332864 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-50a9134c-101c-444c-a2dd-582847b82848 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:52.340909 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-50a9134c-101c-444c-a2dd-582847b82848 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:52.342614 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-50a9134c-101c-444c-a2dd-582847b82848 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:52.343578 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-50a9134c-101c-444c-a2dd-582847b82848 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.145362 Aug 30 07:53:52.344130 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 458/964] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:52 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:53:53.361578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ede103bc-494c-4345-8560-d060c9183893 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:53.362228 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ede103bc-494c-4345-8560-d060c9183893 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:53.368901 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ede103bc-494c-4345-8560-d060c9183893 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:53.369282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ede103bc-494c-4345-8560-d060c9183893 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:53.370070 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ede103bc-494c-4345-8560-d060c9183893 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:53.370540 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ede103bc-494c-4345-8560-d060c9183893 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:53.499598 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ede103bc-494c-4345-8560-d060c9183893 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:53.508261 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ede103bc-494c-4345-8560-d060c9183893 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:53.509778 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-ede103bc-494c-4345-8560-d060c9183893 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:53.511109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ede103bc-494c-4345-8560-d060c9183893 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.153196 Aug 30 07:53:53.511863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 507/965] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:53 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:54.529977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c7a964a9-f1c6-4d7d-b5cc-6d07040fabd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:54.530555 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c7a964a9-f1c6-4d7d-b5cc-6d07040fabd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:54.536330 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c7a964a9-f1c6-4d7d-b5cc-6d07040fabd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:54.536764 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c7a964a9-f1c6-4d7d-b5cc-6d07040fabd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:54.537513 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c7a964a9-f1c6-4d7d-b5cc-6d07040fabd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:54.537939 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c7a964a9-f1c6-4d7d-b5cc-6d07040fabd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:54.662132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c7a964a9-f1c6-4d7d-b5cc-6d07040fabd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:54.670803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c7a964a9-f1c6-4d7d-b5cc-6d07040fabd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:54.672319 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c7a964a9-f1c6-4d7d-b5cc-6d07040fabd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:54.673455 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c7a964a9-f1c6-4d7d-b5cc-6d07040fabd1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.147234 Aug 30 07:53:54.674013 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 459/966] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:54 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:55.692230 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c53939d2-7174-44ba-81e0-d5e8f0f3cc78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:55.693006 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c53939d2-7174-44ba-81e0-d5e8f0f3cc78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:55.700012 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c53939d2-7174-44ba-81e0-d5e8f0f3cc78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:55.700551 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c53939d2-7174-44ba-81e0-d5e8f0f3cc78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:55.701401 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c53939d2-7174-44ba-81e0-d5e8f0f3cc78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:55.701875 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c53939d2-7174-44ba-81e0-d5e8f0f3cc78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:55.823508 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c53939d2-7174-44ba-81e0-d5e8f0f3cc78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:55.831185 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c53939d2-7174-44ba-81e0-d5e8f0f3cc78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:55.832683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c53939d2-7174-44ba-81e0-d5e8f0f3cc78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:55.833816 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c53939d2-7174-44ba-81e0-d5e8f0f3cc78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1743 microversion: 2.20 time: 0.145948 Aug 30 07:53:55.834391 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 508/967] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:55 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1743 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:56.853466 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-69acf404-0f15-4502-8d1a-c1a015674bda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:56.854282 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-69acf404-0f15-4502-8d1a-c1a015674bda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:56.860343 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-69acf404-0f15-4502-8d1a-c1a015674bda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:56.860855 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-69acf404-0f15-4502-8d1a-c1a015674bda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:56.861572 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-69acf404-0f15-4502-8d1a-c1a015674bda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:56.862128 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-69acf404-0f15-4502-8d1a-c1a015674bda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:57.054803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-69acf404-0f15-4502-8d1a-c1a015674bda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:57.062501 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-69acf404-0f15-4502-8d1a-c1a015674bda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:57.063988 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-69acf404-0f15-4502-8d1a-c1a015674bda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:57.065132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-69acf404-0f15-4502-8d1a-c1a015674bda tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1743 microversion: 2.20 time: 0.216617 Aug 30 07:53:57.065686 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 460/968] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:56 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1743 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:58.085129 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-80efa823-a665-4762-bb37-bbb222c0ebdc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:58.086593 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-80efa823-a665-4762-bb37-bbb222c0ebdc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:58.092997 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80efa823-a665-4762-bb37-bbb222c0ebdc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:58.093453 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80efa823-a665-4762-bb37-bbb222c0ebdc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:58.094253 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80efa823-a665-4762-bb37-bbb222c0ebdc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:58.094873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80efa823-a665-4762-bb37-bbb222c0ebdc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:58.235211 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-80efa823-a665-4762-bb37-bbb222c0ebdc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:58.243878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-80efa823-a665-4762-bb37-bbb222c0ebdc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:58.245384 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-80efa823-a665-4762-bb37-bbb222c0ebdc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:58.246547 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-80efa823-a665-4762-bb37-bbb222c0ebdc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1743 microversion: 2.20 time: 0.166423 Aug 30 07:53:58.247123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 509/969] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:58 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:58.556962 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-56063a56-a401-4794-9a24-9a47cfe1af6b tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:58.557459 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-56063a56-a401-4794-9a24-9a47cfe1af6b tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:58.563298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-56063a56-a401-4794-9a24-9a47cfe1af6b tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:58.563742 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-56063a56-a401-4794-9a24-9a47cfe1af6b tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:58.564497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-56063a56-a401-4794-9a24-9a47cfe1af6b tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:58.564923 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-56063a56-a401-4794-9a24-9a47cfe1af6b tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:58.648892 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-56063a56-a401-4794-9a24-9a47cfe1af6b tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lazy-loading 'services' on Instance uuid 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:53:58.713522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-56063a56-a401-4794-9a24-9a47cfe1af6b tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3/os-volume_attachments/c2464415-9f9b-4156-8ecf-59766ddba9f4" status: 202 len: 0 microversion: 2.1 time: 0.160893 Aug 30 07:53:58.714106 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 461/970] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:53:58 2021] DELETE /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3/os-volume_attachments/c2464415-9f9b-4156-8ecf-59766ddba9f4 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:53:59.264770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b13c5029-7628-4479-b667-dc1b5103c81b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:59.265375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b13c5029-7628-4479-b667-dc1b5103c81b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:59.271208 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b13c5029-7628-4479-b667-dc1b5103c81b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:59.271647 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b13c5029-7628-4479-b667-dc1b5103c81b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:59.272398 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b13c5029-7628-4479-b667-dc1b5103c81b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:59.272824 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b13c5029-7628-4479-b667-dc1b5103c81b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:59.400606 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b13c5029-7628-4479-b667-dc1b5103c81b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:59.408526 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b13c5029-7628-4479-b667-dc1b5103c81b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:59.410310 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b13c5029-7628-4479-b667-dc1b5103c81b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:53:59.411434 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b13c5029-7628-4479-b667-dc1b5103c81b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1743 microversion: 2.20 time: 0.150417 Aug 30 07:53:59.412373 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 510/971] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:53:59 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:53:59.842090 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e26c0cc9-1630-4d0d-91ed-0a7596717bc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:53:59.842642 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e26c0cc9-1630-4d0d-91ed-0a7596717bc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:53:59.848876 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e26c0cc9-1630-4d0d-91ed-0a7596717bc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:59.849323 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e26c0cc9-1630-4d0d-91ed-0a7596717bc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:59.850538 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e26c0cc9-1630-4d0d-91ed-0a7596717bc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:53:59.851406 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e26c0cc9-1630-4d0d-91ed-0a7596717bc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:53:59.879235 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e26c0cc9-1630-4d0d-91ed-0a7596717bc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Going to try to terminate instance {{(pid=114670) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:53:59.992294 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e26c0cc9-1630-4d0d-91ed-0a7596717bc6 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 204 len: 0 microversion: 2.1 time: 0.153820 Aug 30 07:53:59.992964 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 462/972] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:53:59 2021] DELETE /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:54:00.001181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7ae7927b-f6e7-41d9-b4af-52d3f3cefeb5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:00.002207 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7ae7927b-f6e7-41d9-b4af-52d3f3cefeb5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:00.007995 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7ae7927b-f6e7-41d9-b4af-52d3f3cefeb5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:00.008707 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7ae7927b-f6e7-41d9-b4af-52d3f3cefeb5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:00.009683 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7ae7927b-f6e7-41d9-b4af-52d3f3cefeb5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:00.010395 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7ae7927b-f6e7-41d9-b4af-52d3f3cefeb5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:00.066893 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-88194a10-1c97-4331-aaed-a4823c645ecc req-a42109ce-daf8-4b03-a462-c8e5c8c8342c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f", "name": "network-vif-plugged", "status": "completed", "tag": "32f744e1-43b5-4cbe-a3b6-9ee81f793879"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:54:00.068683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:54:00.068683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:54:00.076225 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-88194a10-1c97-4331-aaed-a4823c645ecc req-a42109ce-daf8-4b03-a462-c8e5c8c8342c service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:00.077125 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-88194a10-1c97-4331-aaed-a4823c645ecc req-a42109ce-daf8-4b03-a462-c8e5c8c8342c service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:00.088890 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-88194a10-1c97-4331-aaed-a4823c645ecc req-a42109ce-daf8-4b03-a462-c8e5c8c8342c service nova] Creating event network-vif-plugged:32f744e1-43b5-4cbe-a3b6-9ee81f793879 for instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f on hv-cinder-80619 Aug 30 07:54:00.094566 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-88194a10-1c97-4331-aaed-a4823c645ecc req-a42109ce-daf8-4b03-a462-c8e5c8c8342c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186753 Aug 30 07:54:00.095513 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 511/973] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:53:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:54:00.142655 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7ae7927b-f6e7-41d9-b4af-52d3f3cefeb5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:00.150247 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7ae7927b-f6e7-41d9-b4af-52d3f3cefeb5 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1514 microversion: 2.1 time: 0.152912 Aug 30 07:54:00.150823 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 463/974] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:53:59 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:54:00.429163 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4ab57b76-8d11-47bb-b3f9-cad47b0d0ef1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:00.430531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4ab57b76-8d11-47bb-b3f9-cad47b0d0ef1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:00.436362 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4ab57b76-8d11-47bb-b3f9-cad47b0d0ef1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:00.436896 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4ab57b76-8d11-47bb-b3f9-cad47b0d0ef1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:00.437607 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4ab57b76-8d11-47bb-b3f9-cad47b0d0ef1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:00.438043 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4ab57b76-8d11-47bb-b3f9-cad47b0d0ef1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:00.568038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4ab57b76-8d11-47bb-b3f9-cad47b0d0ef1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:00.576511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4ab57b76-8d11-47bb-b3f9-cad47b0d0ef1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:00.578003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4ab57b76-8d11-47bb-b3f9-cad47b0d0ef1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:00.579173 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4ab57b76-8d11-47bb-b3f9-cad47b0d0ef1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1743 microversion: 2.20 time: 0.154095 Aug 30 07:54:00.579963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 512/975] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:00 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:01.167908 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4f38b19d-f8ae-40a2-8dcb-914a4a656294 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:01.168451 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4f38b19d-f8ae-40a2-8dcb-914a4a656294 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:01.174782 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f38b19d-f8ae-40a2-8dcb-914a4a656294 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:01.175227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f38b19d-f8ae-40a2-8dcb-914a4a656294 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:01.175978 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f38b19d-f8ae-40a2-8dcb-914a4a656294 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:01.176406 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f38b19d-f8ae-40a2-8dcb-914a4a656294 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:01.295599 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4f38b19d-f8ae-40a2-8dcb-914a4a656294 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:01.302818 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4f38b19d-f8ae-40a2-8dcb-914a4a656294 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1514 microversion: 2.1 time: 0.139221 Aug 30 07:54:01.303390 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 464/976] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:01 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1514 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:01.597663 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d4d607f5-0c59-4f40-bae3-8c15e81b9c2a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:01.598321 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d4d607f5-0c59-4f40-bae3-8c15e81b9c2a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:01.604456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4d607f5-0c59-4f40-bae3-8c15e81b9c2a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:01.604895 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4d607f5-0c59-4f40-bae3-8c15e81b9c2a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:01.605644 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4d607f5-0c59-4f40-bae3-8c15e81b9c2a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:01.606076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4d607f5-0c59-4f40-bae3-8c15e81b9c2a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:01.727573 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d4d607f5-0c59-4f40-bae3-8c15e81b9c2a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:01.735642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d4d607f5-0c59-4f40-bae3-8c15e81b9c2a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:01.737140 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d4d607f5-0c59-4f40-bae3-8c15e81b9c2a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:01.738719 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d4d607f5-0c59-4f40-bae3-8c15e81b9c2a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1743 microversion: 2.20 time: 0.144856 Aug 30 07:54:01.739274 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 513/977] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:01 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1743 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:02.319713 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8ac6ed9c-24d6-48d8-b121-5bd1cfa4e5ec tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:02.320343 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8ac6ed9c-24d6-48d8-b121-5bd1cfa4e5ec tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:02.325998 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8ac6ed9c-24d6-48d8-b121-5bd1cfa4e5ec tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:02.326468 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8ac6ed9c-24d6-48d8-b121-5bd1cfa4e5ec tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:02.327223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8ac6ed9c-24d6-48d8-b121-5bd1cfa4e5ec tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:02.327652 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8ac6ed9c-24d6-48d8-b121-5bd1cfa4e5ec tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:02.456282 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8ac6ed9c-24d6-48d8-b121-5bd1cfa4e5ec tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:02.464138 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8ac6ed9c-24d6-48d8-b121-5bd1cfa4e5ec tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1514 microversion: 2.1 time: 0.148015 Aug 30 07:54:02.464710 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 465/978] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:02 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:02.756522 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dcfcdf21-0d2a-4747-abfa-8733c6bb12e5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:02.757125 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dcfcdf21-0d2a-4747-abfa-8733c6bb12e5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:02.763085 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dcfcdf21-0d2a-4747-abfa-8733c6bb12e5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:02.763524 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dcfcdf21-0d2a-4747-abfa-8733c6bb12e5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:02.764347 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dcfcdf21-0d2a-4747-abfa-8733c6bb12e5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:02.764803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dcfcdf21-0d2a-4747-abfa-8733c6bb12e5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:02.892905 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-dcfcdf21-0d2a-4747-abfa-8733c6bb12e5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:02.901294 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-dcfcdf21-0d2a-4747-abfa-8733c6bb12e5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:02.902963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-dcfcdf21-0d2a-4747-abfa-8733c6bb12e5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:02.904103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dcfcdf21-0d2a-4747-abfa-8733c6bb12e5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1743 microversion: 2.20 time: 0.151274 Aug 30 07:54:02.904659 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 514/979] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:02 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:03.481200 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-61cdb8b9-b464-48a2-8b83-b99768abac91 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:03.481812 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-61cdb8b9-b464-48a2-8b83-b99768abac91 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:03.487604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61cdb8b9-b464-48a2-8b83-b99768abac91 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:03.487976 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61cdb8b9-b464-48a2-8b83-b99768abac91 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:03.488913 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61cdb8b9-b464-48a2-8b83-b99768abac91 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:03.489313 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61cdb8b9-b464-48a2-8b83-b99768abac91 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:03.613318 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-61cdb8b9-b464-48a2-8b83-b99768abac91 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:03.621419 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-61cdb8b9-b464-48a2-8b83-b99768abac91 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1514 microversion: 2.1 time: 0.144078 Aug 30 07:54:03.621979 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 466/980] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:03 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:03.922803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-df02b185-773f-4406-becb-95f6f102b4c2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:03.923488 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-df02b185-773f-4406-becb-95f6f102b4c2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:03.929479 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df02b185-773f-4406-becb-95f6f102b4c2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:03.930754 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df02b185-773f-4406-becb-95f6f102b4c2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:03.931618 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df02b185-773f-4406-becb-95f6f102b4c2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:03.932052 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df02b185-773f-4406-becb-95f6f102b4c2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:04.074167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-df02b185-773f-4406-becb-95f6f102b4c2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:04.086041 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-df02b185-773f-4406-becb-95f6f102b4c2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:04.087926 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-df02b185-773f-4406-becb-95f6f102b4c2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:04.090814 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-df02b185-773f-4406-becb-95f6f102b4c2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1743 microversion: 2.20 time: 0.170001 Aug 30 07:54:04.091646 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 515/981] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:03 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:04.533654 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-b6ffb56d-cf20-4f30-9487-83fd830dc18e req-09dee79f-76f7-4e1c-ba13-f3d143217262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b8dae88-04c6-4417-b5ef-40ab8c78c7f3", "name": "network-vif-deleted", "tag": "5e231977-0ba0-4d48-bc2c-cdbdab84ff26"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:54:04.535288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:54:04.535288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:54:04.543441 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-b6ffb56d-cf20-4f30-9487-83fd830dc18e req-09dee79f-76f7-4e1c-ba13-f3d143217262 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:04.543878 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-b6ffb56d-cf20-4f30-9487-83fd830dc18e req-09dee79f-76f7-4e1c-ba13-f3d143217262 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:04.555831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-b6ffb56d-cf20-4f30-9487-83fd830dc18e req-09dee79f-76f7-4e1c-ba13-f3d143217262 service nova] Creating event network-vif-deleted:5e231977-0ba0-4d48-bc2c-cdbdab84ff26 for instance 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 on hv-cinder-80619 Aug 30 07:54:04.560892 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-b6ffb56d-cf20-4f30-9487-83fd830dc18e req-09dee79f-76f7-4e1c-ba13-f3d143217262 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167844 Aug 30 07:54:04.561569 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 467/982] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:54:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:54:04.639376 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-405e1539-7fdb-43a4-acae-53e7ece0ade8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:04.639998 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-405e1539-7fdb-43a4-acae-53e7ece0ade8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:04.645885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-405e1539-7fdb-43a4-acae-53e7ece0ade8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:04.646379 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-405e1539-7fdb-43a4-acae-53e7ece0ade8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:04.647179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-405e1539-7fdb-43a4-acae-53e7ece0ade8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:04.647653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-405e1539-7fdb-43a4-acae-53e7ece0ade8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:04.682866 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-405e1539-7fdb-43a4-acae-53e7ece0ade8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:04.683313 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-405e1539-7fdb-43a4-acae-53e7ece0ade8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:04.683854 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-405e1539-7fdb-43a4-acae-53e7ece0ade8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lazy-loading 'fault' on Instance uuid 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:54:04.730300 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-405e1539-7fdb-43a4-acae-53e7ece0ade8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ec2ba0f5604cda983592b6036da5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f802845196ae419e94d4aa18c6cb0344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:04.737569 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-405e1539-7fdb-43a4-acae-53e7ece0ade8 tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 200 len: 1309 microversion: 2.1 time: 0.101911 Aug 30 07:54:04.738214 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 516/983] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:04 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:05.109925 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cb68346e-af3c-4c39-8c40-e8f65e798400 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:05.110635 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-cb68346e-af3c-4c39-8c40-e8f65e798400 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:05.116732 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cb68346e-af3c-4c39-8c40-e8f65e798400 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:05.117257 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cb68346e-af3c-4c39-8c40-e8f65e798400 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:05.118141 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cb68346e-af3c-4c39-8c40-e8f65e798400 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:05.118840 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cb68346e-af3c-4c39-8c40-e8f65e798400 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:05.268697 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-cb68346e-af3c-4c39-8c40-e8f65e798400 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:05.276968 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-cb68346e-af3c-4c39-8c40-e8f65e798400 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:05.278495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-cb68346e-af3c-4c39-8c40-e8f65e798400 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:05.279629 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-cb68346e-af3c-4c39-8c40-e8f65e798400 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1743 microversion: 2.20 time: 0.173735 Aug 30 07:54:05.280223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 468/984] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:05 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:05.756144 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-af204fe5-7182-4a71-baca-bf485759141a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:05.756976 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-af204fe5-7182-4a71-baca-bf485759141a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] [instance: 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:05.763642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af204fe5-7182-4a71-baca-bf485759141a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:05.764090 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af204fe5-7182-4a71-baca-bf485759141a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:05.764871 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af204fe5-7182-4a71-baca-bf485759141a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:05.765312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af204fe5-7182-4a71-baca-bf485759141a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:05.779826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-af204fe5-7182-4a71-baca-bf485759141a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] HTTP exception thrown: Instance 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 could not be found. Aug 30 07:54:05.780438 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-af204fe5-7182-4a71-baca-bf485759141a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] Returning 404 to user: Instance 8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:54:05.781295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-af204fe5-7182-4a71-baca-bf485759141a tempest-VolumesSnapshotTestJSON-427487777 tempest-VolumesSnapshotTestJSON-427487777-project] 10.222.0.73 "GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3" status: 404 len: 111 microversion: 2.1 time: 0.028966 Aug 30 07:54:05.781852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 517/985] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:05 2021] GET /compute/v2.1/servers/8b8dae88-04c6-4417-b5ef-40ab8c78c7f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:54:06.300716 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9793a7fd-b6ce-4555-a99b-fd7063d7013e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:06.301325 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9793a7fd-b6ce-4555-a99b-fd7063d7013e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:06.315522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9793a7fd-b6ce-4555-a99b-fd7063d7013e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:06.318111 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9793a7fd-b6ce-4555-a99b-fd7063d7013e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:06.319128 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9793a7fd-b6ce-4555-a99b-fd7063d7013e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:06.319751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9793a7fd-b6ce-4555-a99b-fd7063d7013e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:06.489236 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9793a7fd-b6ce-4555-a99b-fd7063d7013e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:06.504007 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9793a7fd-b6ce-4555-a99b-fd7063d7013e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:06.505645 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9793a7fd-b6ce-4555-a99b-fd7063d7013e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:06.506843 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9793a7fd-b6ce-4555-a99b-fd7063d7013e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.211678 Aug 30 07:54:06.518733 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 469/986] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:06 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:07.527400 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3ae8390b-051c-4f08-8f21-ff23c99fa4cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:07.528575 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3ae8390b-051c-4f08-8f21-ff23c99fa4cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:07.543786 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ae8390b-051c-4f08-8f21-ff23c99fa4cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:07.544573 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ae8390b-051c-4f08-8f21-ff23c99fa4cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:07.545610 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ae8390b-051c-4f08-8f21-ff23c99fa4cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:07.546291 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3ae8390b-051c-4f08-8f21-ff23c99fa4cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:07.772346 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3ae8390b-051c-4f08-8f21-ff23c99fa4cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:07.789777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3ae8390b-051c-4f08-8f21-ff23c99fa4cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:07.791330 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3ae8390b-051c-4f08-8f21-ff23c99fa4cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:07.799584 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3ae8390b-051c-4f08-8f21-ff23c99fa4cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.275900 Aug 30 07:54:07.801816 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 518/987] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:07 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:08.822431 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-97479ac9-73fa-402c-8d7e-5200c2d8b6f0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:08.823794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-97479ac9-73fa-402c-8d7e-5200c2d8b6f0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:08.845776 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-97479ac9-73fa-402c-8d7e-5200c2d8b6f0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:08.849204 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-97479ac9-73fa-402c-8d7e-5200c2d8b6f0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:08.854251 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-97479ac9-73fa-402c-8d7e-5200c2d8b6f0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:08.854506 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-97479ac9-73fa-402c-8d7e-5200c2d8b6f0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:09.163348 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-97479ac9-73fa-402c-8d7e-5200c2d8b6f0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:09.177893 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-97479ac9-73fa-402c-8d7e-5200c2d8b6f0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:09.182482 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-97479ac9-73fa-402c-8d7e-5200c2d8b6f0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:09.183668 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-97479ac9-73fa-402c-8d7e-5200c2d8b6f0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.366845 Aug 30 07:54:09.195400 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 470/988] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:08 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:10.200623 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-07e4117f-e617-4d9f-bb14-3b83a3720343 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:10.201853 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-07e4117f-e617-4d9f-bb14-3b83a3720343 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:10.213029 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07e4117f-e617-4d9f-bb14-3b83a3720343 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:10.213739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07e4117f-e617-4d9f-bb14-3b83a3720343 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:10.214737 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07e4117f-e617-4d9f-bb14-3b83a3720343 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:10.215332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-07e4117f-e617-4d9f-bb14-3b83a3720343 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:10.477163 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-07e4117f-e617-4d9f-bb14-3b83a3720343 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:10.486568 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-07e4117f-e617-4d9f-bb14-3b83a3720343 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:10.490383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-07e4117f-e617-4d9f-bb14-3b83a3720343 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:10.492290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-07e4117f-e617-4d9f-bb14-3b83a3720343 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.294836 Aug 30 07:54:10.492847 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 519/989] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:10 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:11.514252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5f5db3fb-6ee2-458e-8a3c-77f91b27c49d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:11.515568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5f5db3fb-6ee2-458e-8a3c-77f91b27c49d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:11.523387 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f5db3fb-6ee2-458e-8a3c-77f91b27c49d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:11.524261 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f5db3fb-6ee2-458e-8a3c-77f91b27c49d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:11.527499 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f5db3fb-6ee2-458e-8a3c-77f91b27c49d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:11.530136 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5f5db3fb-6ee2-458e-8a3c-77f91b27c49d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:11.960058 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5f5db3fb-6ee2-458e-8a3c-77f91b27c49d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:11.970803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5f5db3fb-6ee2-458e-8a3c-77f91b27c49d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:11.972824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5f5db3fb-6ee2-458e-8a3c-77f91b27c49d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:11.974249 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5f5db3fb-6ee2-458e-8a3c-77f91b27c49d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.465286 Aug 30 07:54:11.975322 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 471/990] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:11 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:12.994489 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7de48ee8-5928-4c58-8543-ba779e32c963 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:12.996830 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7de48ee8-5928-4c58-8543-ba779e32c963 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:13.005150 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7de48ee8-5928-4c58-8543-ba779e32c963 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:13.005925 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7de48ee8-5928-4c58-8543-ba779e32c963 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:13.007145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7de48ee8-5928-4c58-8543-ba779e32c963 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:13.009078 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7de48ee8-5928-4c58-8543-ba779e32c963 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:13.202013 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7de48ee8-5928-4c58-8543-ba779e32c963 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:13.212513 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7de48ee8-5928-4c58-8543-ba779e32c963 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:13.214511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7de48ee8-5928-4c58-8543-ba779e32c963 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:13.215993 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7de48ee8-5928-4c58-8543-ba779e32c963 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.227097 Aug 30 07:54:13.216780 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 520/991] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:12 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:14.238076 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6d3b8ec7-5a0a-4f08-b0c5-14d4f1d5e45e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:14.240293 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6d3b8ec7-5a0a-4f08-b0c5-14d4f1d5e45e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:14.255552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ec7-5a0a-4f08-b0c5-14d4f1d5e45e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:14.258005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ec7-5a0a-4f08-b0c5-14d4f1d5e45e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:14.260691 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ec7-5a0a-4f08-b0c5-14d4f1d5e45e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:14.261423 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ec7-5a0a-4f08-b0c5-14d4f1d5e45e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:15.091201 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6d3b8ec7-5a0a-4f08-b0c5-14d4f1d5e45e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:15.103339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6d3b8ec7-5a0a-4f08-b0c5-14d4f1d5e45e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:15.111246 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6d3b8ec7-5a0a-4f08-b0c5-14d4f1d5e45e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:15.115508 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6d3b8ec7-5a0a-4f08-b0c5-14d4f1d5e45e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.882709 Aug 30 07:54:15.118450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 472/992] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:14 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:16.136381 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-06c08567-1efe-4182-b2ae-eb423a9fd512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:16.136976 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-06c08567-1efe-4182-b2ae-eb423a9fd512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:16.145572 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06c08567-1efe-4182-b2ae-eb423a9fd512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:16.146011 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06c08567-1efe-4182-b2ae-eb423a9fd512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:16.162334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06c08567-1efe-4182-b2ae-eb423a9fd512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:16.162334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-06c08567-1efe-4182-b2ae-eb423a9fd512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:16.461968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-06c08567-1efe-4182-b2ae-eb423a9fd512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:16.472713 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-06c08567-1efe-4182-b2ae-eb423a9fd512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:16.474297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-06c08567-1efe-4182-b2ae-eb423a9fd512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:16.476915 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-06c08567-1efe-4182-b2ae-eb423a9fd512 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.342937 Aug 30 07:54:16.478292 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 521/993] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:16 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:17.496427 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d0e08eb5-6bcd-4bb7-9068-0c0148b94529 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:17.497182 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d0e08eb5-6bcd-4bb7-9068-0c0148b94529 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:17.511238 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d0e08eb5-6bcd-4bb7-9068-0c0148b94529 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:17.516820 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d0e08eb5-6bcd-4bb7-9068-0c0148b94529 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:17.517959 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d0e08eb5-6bcd-4bb7-9068-0c0148b94529 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:17.518579 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d0e08eb5-6bcd-4bb7-9068-0c0148b94529 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:17.793092 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d0e08eb5-6bcd-4bb7-9068-0c0148b94529 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:17.801468 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d0e08eb5-6bcd-4bb7-9068-0c0148b94529 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:17.803332 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d0e08eb5-6bcd-4bb7-9068-0c0148b94529 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:17.805521 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d0e08eb5-6bcd-4bb7-9068-0c0148b94529 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.312733 Aug 30 07:54:17.822808 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 473/994] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:17 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:18.829653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8727402a-c79b-4c5c-836a-f7d0b20d5c2e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:18.830954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8727402a-c79b-4c5c-836a-f7d0b20d5c2e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:18.838387 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8727402a-c79b-4c5c-836a-f7d0b20d5c2e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:18.839362 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8727402a-c79b-4c5c-836a-f7d0b20d5c2e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:18.840457 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8727402a-c79b-4c5c-836a-f7d0b20d5c2e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:18.844374 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8727402a-c79b-4c5c-836a-f7d0b20d5c2e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:19.159133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8727402a-c79b-4c5c-836a-f7d0b20d5c2e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:19.173614 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8727402a-c79b-4c5c-836a-f7d0b20d5c2e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:19.176487 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8727402a-c79b-4c5c-836a-f7d0b20d5c2e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:19.179495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8727402a-c79b-4c5c-836a-f7d0b20d5c2e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.354000 Aug 30 07:54:19.184495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 522/995] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:18 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:20.201641 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c26aca59-03bd-4e5a-84b6-cb37ca5e983d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:20.203100 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c26aca59-03bd-4e5a-84b6-cb37ca5e983d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:20.218082 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c26aca59-03bd-4e5a-84b6-cb37ca5e983d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:20.220755 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c26aca59-03bd-4e5a-84b6-cb37ca5e983d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:20.221739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c26aca59-03bd-4e5a-84b6-cb37ca5e983d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:20.222384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c26aca59-03bd-4e5a-84b6-cb37ca5e983d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:20.509059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c26aca59-03bd-4e5a-84b6-cb37ca5e983d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:20.523126 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c26aca59-03bd-4e5a-84b6-cb37ca5e983d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:20.525165 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c26aca59-03bd-4e5a-84b6-cb37ca5e983d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:20.531660 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c26aca59-03bd-4e5a-84b6-cb37ca5e983d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.333697 Aug 30 07:54:20.532564 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 474/996] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:20 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:21.552149 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-576c39c5-f092-414c-a3c1-4efbd1d0fea3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:21.554136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-576c39c5-f092-414c-a3c1-4efbd1d0fea3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:21.569960 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-576c39c5-f092-414c-a3c1-4efbd1d0fea3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:21.571129 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-576c39c5-f092-414c-a3c1-4efbd1d0fea3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:21.572481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-576c39c5-f092-414c-a3c1-4efbd1d0fea3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:21.573180 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-576c39c5-f092-414c-a3c1-4efbd1d0fea3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:21.835147 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-576c39c5-f092-414c-a3c1-4efbd1d0fea3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:21.845992 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-576c39c5-f092-414c-a3c1-4efbd1d0fea3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:21.848759 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-576c39c5-f092-414c-a3c1-4efbd1d0fea3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:21.851176 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-576c39c5-f092-414c-a3c1-4efbd1d0fea3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.303161 Aug 30 07:54:21.852244 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 523/997] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:21 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:22.869771 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-528ea6b5-25a5-4d02-895b-d801b432b521 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:22.871111 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-528ea6b5-25a5-4d02-895b-d801b432b521 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:22.879400 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-528ea6b5-25a5-4d02-895b-d801b432b521 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:22.880738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-528ea6b5-25a5-4d02-895b-d801b432b521 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:22.881915 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-528ea6b5-25a5-4d02-895b-d801b432b521 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:22.882765 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-528ea6b5-25a5-4d02-895b-d801b432b521 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:23.020792 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-528ea6b5-25a5-4d02-895b-d801b432b521 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:23.030482 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-528ea6b5-25a5-4d02-895b-d801b432b521 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:23.032302 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-528ea6b5-25a5-4d02-895b-d801b432b521 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:23.033676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-528ea6b5-25a5-4d02-895b-d801b432b521 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.168442 Aug 30 07:54:23.034532 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 475/998] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:22 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:24.053492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d9e763d9-a492-4d93-bbf7-3ecc1f78f628 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:24.055116 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d9e763d9-a492-4d93-bbf7-3ecc1f78f628 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:24.063175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9e763d9-a492-4d93-bbf7-3ecc1f78f628 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:24.065104 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9e763d9-a492-4d93-bbf7-3ecc1f78f628 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:24.065910 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9e763d9-a492-4d93-bbf7-3ecc1f78f628 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:24.066383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9e763d9-a492-4d93-bbf7-3ecc1f78f628 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:24.198506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d9e763d9-a492-4d93-bbf7-3ecc1f78f628 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:24.209224 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d9e763d9-a492-4d93-bbf7-3ecc1f78f628 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:24.211283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d9e763d9-a492-4d93-bbf7-3ecc1f78f628 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:24.212673 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d9e763d9-a492-4d93-bbf7-3ecc1f78f628 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1738 microversion: 2.20 time: 0.163717 Aug 30 07:54:24.214074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 524/999] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:24 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:25.233656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9b1bd0b8-74c9-45c1-ad67-70ee40ade360 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:25.234911 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9b1bd0b8-74c9-45c1-ad67-70ee40ade360 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:25.245205 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b1bd0b8-74c9-45c1-ad67-70ee40ade360 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:25.247036 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b1bd0b8-74c9-45c1-ad67-70ee40ade360 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:25.247223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b1bd0b8-74c9-45c1-ad67-70ee40ade360 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:25.247948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b1bd0b8-74c9-45c1-ad67-70ee40ade360 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:25.436268 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9b1bd0b8-74c9-45c1-ad67-70ee40ade360 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:25.445098 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9b1bd0b8-74c9-45c1-ad67-70ee40ade360 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:25.446945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9b1bd0b8-74c9-45c1-ad67-70ee40ade360 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:25.448601 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9b1bd0b8-74c9-45c1-ad67-70ee40ade360 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1720 microversion: 2.20 time: 0.221457 Aug 30 07:54:25.449523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 476/1000] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:25 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:26.468637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-85c27360-2664-416b-a1bc-57e61331c8e8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:26.469966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-85c27360-2664-416b-a1bc-57e61331c8e8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:26.476706 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-85c27360-2664-416b-a1bc-57e61331c8e8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:26.477373 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-85c27360-2664-416b-a1bc-57e61331c8e8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:26.478168 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-85c27360-2664-416b-a1bc-57e61331c8e8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:26.478594 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-85c27360-2664-416b-a1bc-57e61331c8e8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:26.612261 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-85c27360-2664-416b-a1bc-57e61331c8e8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:26.621054 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-85c27360-2664-416b-a1bc-57e61331c8e8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:26.622600 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-85c27360-2664-416b-a1bc-57e61331c8e8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:26.623751 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-85c27360-2664-416b-a1bc-57e61331c8e8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1720 microversion: 2.20 time: 0.159456 Aug 30 07:54:26.624302 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 525/1001] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:26 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:27.641852 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c6fecd8c-eb4a-4788-9aea-49f8466a02d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:27.642524 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c6fecd8c-eb4a-4788-9aea-49f8466a02d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:27.654799 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c6fecd8c-eb4a-4788-9aea-49f8466a02d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:27.655694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c6fecd8c-eb4a-4788-9aea-49f8466a02d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:27.656596 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c6fecd8c-eb4a-4788-9aea-49f8466a02d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:27.657172 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c6fecd8c-eb4a-4788-9aea-49f8466a02d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:27.802004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c6fecd8c-eb4a-4788-9aea-49f8466a02d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:27.811004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c6fecd8c-eb4a-4788-9aea-49f8466a02d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:27.812525 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c6fecd8c-eb4a-4788-9aea-49f8466a02d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:27.813782 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c6fecd8c-eb4a-4788-9aea-49f8466a02d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1720 microversion: 2.20 time: 0.175566 Aug 30 07:54:27.814396 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 477/1002] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:27 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:28.037414 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-6cdccb9b-bdb5-4556-a12a-e083b8c2e8eb req-c78e9457-4213-4aec-827a-7554d564dc54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f", "name": "network-vif-unplugged", "status": "completed", "tag": "32f744e1-43b5-4cbe-a3b6-9ee81f793879"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:54:28.038994 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:54:28.038994 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:54:28.046971 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-6cdccb9b-bdb5-4556-a12a-e083b8c2e8eb req-c78e9457-4213-4aec-827a-7554d564dc54 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:28.047971 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-6cdccb9b-bdb5-4556-a12a-e083b8c2e8eb req-c78e9457-4213-4aec-827a-7554d564dc54 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:28.061765 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-6cdccb9b-bdb5-4556-a12a-e083b8c2e8eb req-c78e9457-4213-4aec-827a-7554d564dc54 service nova] Creating event network-vif-unplugged:32f744e1-43b5-4cbe-a3b6-9ee81f793879 for instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f on hv-cinder-80619 Aug 30 07:54:28.067325 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-6cdccb9b-bdb5-4556-a12a-e083b8c2e8eb req-c78e9457-4213-4aec-827a-7554d564dc54 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033859 Aug 30 07:54:28.068116 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 526/1003] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:54:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:54:28.600016 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f49a0377-991b-4296-aabd-fe098e76b713 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Action: 'create', calling method: .version_select at 0x7f341c141670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1899802726"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:54:28.617704 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-f49a0377-991b-4296-aabd-fe098e76b713 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Getting quotas for project f16062b13b0c4cd2be8f26f9e093d9bf. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:54:28.621429 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-f49a0377-991b-4296-aabd-fe098e76b713 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Getting quotas for user b351a2f80c7840ddae631ef1431251c5 and project f16062b13b0c4cd2be8f26f9e093d9bf. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:54:28.633497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f49a0377-991b-4296-aabd-fe098e76b713 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [6f6ab7d2-f890-4e22-a048-e5673bb1f4a9] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 07:54:28.833625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-59ca0c44-4dc0-48f7-a582-1e6df71ed195 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:28.834334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-59ca0c44-4dc0-48f7-a582-1e6df71ed195 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:28.840393 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-59ca0c44-4dc0-48f7-a582-1e6df71ed195 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:28.840833 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-59ca0c44-4dc0-48f7-a582-1e6df71ed195 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:28.841584 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-59ca0c44-4dc0-48f7-a582-1e6df71ed195 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:28.842048 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-59ca0c44-4dc0-48f7-a582-1e6df71ed195 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:28.965210 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-59ca0c44-4dc0-48f7-a582-1e6df71ed195 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:28.973035 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-59ca0c44-4dc0-48f7-a582-1e6df71ed195 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:28.975080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-59ca0c44-4dc0-48f7-a582-1e6df71ed195 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:28.976296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-59ca0c44-4dc0-48f7-a582-1e6df71ed195 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1663 microversion: 2.20 time: 0.146878 Aug 30 07:54:28.976853 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 527/1004] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:28 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1663 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:54:28.994317 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-12e056fd-32db-444b-a2b8-16c78cfb1226 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6c942c1-9696-4fed-8db6-80e6ee20ebb2"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:54:28.995369 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-12e056fd-32db-444b-a2b8-16c78cfb1226 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:29.001020 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-12e056fd-32db-444b-a2b8-16c78cfb1226 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:29.001468 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-12e056fd-32db-444b-a2b8-16c78cfb1226 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:29.002254 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-12e056fd-32db-444b-a2b8-16c78cfb1226 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:29.002688 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-12e056fd-32db-444b-a2b8-16c78cfb1226 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:29.279725 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-12e056fd-32db-444b-a2b8-16c78cfb1226 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289353 Aug 30 07:54:29.280832 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 528/1005] 10.222.0.73 () {62 vars in 1364 bytes} [Mon Aug 30 07:54:28 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:54:29.420646 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-290993b7-bb0a-4509-8ab7-e90fd87b7cd4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:54:29.421558 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-290993b7-bb0a-4509-8ab7-e90fd87b7cd4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:29.429996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-290993b7-bb0a-4509-8ab7-e90fd87b7cd4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:29.430493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-290993b7-bb0a-4509-8ab7-e90fd87b7cd4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:29.431290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-290993b7-bb0a-4509-8ab7-e90fd87b7cd4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:29.431731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-290993b7-bb0a-4509-8ab7-e90fd87b7cd4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:29.514765 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-290993b7-bb0a-4509-8ab7-e90fd87b7cd4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action" status: 202 len: 0 microversion: 2.20 time: 0.098039 Aug 30 07:54:29.515356 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 529/1006] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:54:29 2021] POST /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 07:54:29.523677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a44f5d58-ef23-4f2b-aee5-8713791eb77c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:29.524547 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a44f5d58-ef23-4f2b-aee5-8713791eb77c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:29.530459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a44f5d58-ef23-4f2b-aee5-8713791eb77c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:29.530909 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a44f5d58-ef23-4f2b-aee5-8713791eb77c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:29.531675 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a44f5d58-ef23-4f2b-aee5-8713791eb77c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:29.532112 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a44f5d58-ef23-4f2b-aee5-8713791eb77c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:29.652602 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [None req-f49a0377-991b-4296-aabd-fe098e76b713 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [6f6ab7d2-f890-4e22-a048-e5673bb1f4a9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59034. Aug 30 07:54:29.669065 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a44f5d58-ef23-4f2b-aee5-8713791eb77c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:29.681188 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a44f5d58-ef23-4f2b-aee5-8713791eb77c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:29.682961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a44f5d58-ef23-4f2b-aee5-8713791eb77c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:29.684241 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a44f5d58-ef23-4f2b-aee5-8713791eb77c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1749 microversion: 2.20 time: 0.164933 Aug 30 07:54:29.684912 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 530/1007] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:29 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:54:29.986815 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-f49a0377-991b-4296-aabd-fe098e76b713 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Getting quotas for project f16062b13b0c4cd2be8f26f9e093d9bf. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:54:29.990878 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-f49a0377-991b-4296-aabd-fe098e76b713 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Getting quotas for user b351a2f80c7840ddae631ef1431251c5 and project f16062b13b0c4cd2be8f26f9e093d9bf. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:54:30.003967 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f49a0377-991b-4296-aabd-fe098e76b713 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.407497 Aug 30 07:54:30.004461 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 478/1008] 10.222.0.73 () {60 vars in 1158 bytes} [Mon Aug 30 07:54:28 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:30.104017 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-274349361", "imageRef": "0ca9ac4c-8aec-4800-9a41-48e189451322", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1899802726", "networks": [{"uuid": "4aff6f5d-b421-4f3d-ae68-aa08a1a96e0f"}]}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:54:30.153396 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.network.neutron [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] validate_networks() for [('4aff6f5d-b421-4f3d-ae68-aa08a1a96e0f', None, None, None, None, None)] {{(pid=114671) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:54:30.595579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Flavor limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:54:30.596206 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Image limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:54:30.596454 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Flavor pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:54:30.596853 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Image pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:54:30.597263 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:54:30.607432 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:30.607878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:30.609064 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:30.609491 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:30.627729 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Getting quotas for project f16062b13b0c4cd2be8f26f9e093d9bf. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:54:30.633245 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Getting quotas for user b351a2f80c7840ddae631ef1431251c5 and project f16062b13b0c4cd2be8f26f9e093d9bf. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:54:30.644362 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Going to run 1 instances... {{(pid=114671) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:54:30.647025 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ca9ac4c-8aec-4800-9a41-48e189451322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:54:30.697580 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-aa0648ad-3584-4841-b671-a125c335364b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597183 Aug 30 07:54:30.698366 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 531/1009] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:54:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:54:30.704470 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-61018119-ddc7-4bb5-8ea7-fe9a0b5375d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:30.705176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-61018119-ddc7-4bb5-8ea7-fe9a0b5375d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:30.708539 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9a7ce4bf-0ca9-47bc-ab61-adaaa06cdfd1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:30.709225 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9a7ce4bf-0ca9-47bc-ab61-adaaa06cdfd1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:30.714024 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61018119-ddc7-4bb5-8ea7-fe9a0b5375d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:30.715080 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61018119-ddc7-4bb5-8ea7-fe9a0b5375d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:30.715953 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61018119-ddc7-4bb5-8ea7-fe9a0b5375d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:30.716457 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61018119-ddc7-4bb5-8ea7-fe9a0b5375d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:30.764356 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9a7ce4bf-0ca9-47bc-ab61-adaaa06cdfd1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:30.770837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9a7ce4bf-0ca9-47bc-ab61-adaaa06cdfd1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1258 microversion: 2.1 time: 0.065978 Aug 30 07:54:30.771405 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 532/1010] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:30 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:30.844221 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-61018119-ddc7-4bb5-8ea7-fe9a0b5375d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:30.853243 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-61018119-ddc7-4bb5-8ea7-fe9a0b5375d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:30.854770 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-61018119-ddc7-4bb5-8ea7-fe9a0b5375d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:30.855909 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-61018119-ddc7-4bb5-8ea7-fe9a0b5375d5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1751 microversion: 2.20 time: 0.155432 Aug 30 07:54:30.856664 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 479/1011] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:30 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:54:31.788907 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2f183592-552f-4926-a089-4dd3ef0b313f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:31.789658 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2f183592-552f-4926-a089-4dd3ef0b313f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:31.796364 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f183592-552f-4926-a089-4dd3ef0b313f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:31.797023 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f183592-552f-4926-a089-4dd3ef0b313f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:31.797902 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f183592-552f-4926-a089-4dd3ef0b313f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:31.798470 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2f183592-552f-4926-a089-4dd3ef0b313f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:31.860311 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2f183592-552f-4926-a089-4dd3ef0b313f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:31.868801 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2f183592-552f-4926-a089-4dd3ef0b313f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1328 microversion: 2.1 time: 0.085132 Aug 30 07:54:31.869371 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 533/1012] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:31 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1328 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:31.874253 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c4100f92-eff6-4cf8-914b-6f21b7d696fd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:31.875397 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c4100f92-eff6-4cf8-914b-6f21b7d696fd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:31.881083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4100f92-eff6-4cf8-914b-6f21b7d696fd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:31.881543 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4100f92-eff6-4cf8-914b-6f21b7d696fd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:31.883113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4100f92-eff6-4cf8-914b-6f21b7d696fd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:31.883733 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4100f92-eff6-4cf8-914b-6f21b7d696fd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:32.158415 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c4100f92-eff6-4cf8-914b-6f21b7d696fd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:32.168089 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c4100f92-eff6-4cf8-914b-6f21b7d696fd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:32.169712 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c4100f92-eff6-4cf8-914b-6f21b7d696fd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:32.170979 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c4100f92-eff6-4cf8-914b-6f21b7d696fd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.300351 Aug 30 07:54:32.171621 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 480/1013] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:31 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:32.889152 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fe3c2f68-5ec4-429a-a207-02770495dc21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:32.890380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fe3c2f68-5ec4-429a-a207-02770495dc21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:32.907028 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe3c2f68-5ec4-429a-a207-02770495dc21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:32.907701 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe3c2f68-5ec4-429a-a207-02770495dc21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:32.909983 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe3c2f68-5ec4-429a-a207-02770495dc21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:32.910689 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe3c2f68-5ec4-429a-a207-02770495dc21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:33.067011 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-fe3c2f68-5ec4-429a-a207-02770495dc21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:33.075923 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fe3c2f68-5ec4-429a-a207-02770495dc21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.192260 Aug 30 07:54:33.076511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 534/1014] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:32 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:33.313554 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-135dbac6-17ae-406b-9f28-62bace1a6001 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:33.314178 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-135dbac6-17ae-406b-9f28-62bace1a6001 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:33.320402 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-135dbac6-17ae-406b-9f28-62bace1a6001 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:33.320851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-135dbac6-17ae-406b-9f28-62bace1a6001 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:33.321621 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-135dbac6-17ae-406b-9f28-62bace1a6001 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:33.322265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-135dbac6-17ae-406b-9f28-62bace1a6001 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:33.469586 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-135dbac6-17ae-406b-9f28-62bace1a6001 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:33.478800 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-135dbac6-17ae-406b-9f28-62bace1a6001 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:33.480341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-135dbac6-17ae-406b-9f28-62bace1a6001 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:33.481504 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-135dbac6-17ae-406b-9f28-62bace1a6001 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.294792 Aug 30 07:54:33.482076 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 481/1015] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:33 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:34.093777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-081ebdcc-ec88-4314-8018-0b047a97ba89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:34.095502 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-081ebdcc-ec88-4314-8018-0b047a97ba89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:34.103490 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-081ebdcc-ec88-4314-8018-0b047a97ba89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:34.103943 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-081ebdcc-ec88-4314-8018-0b047a97ba89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:34.106181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-081ebdcc-ec88-4314-8018-0b047a97ba89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:34.114493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-081ebdcc-ec88-4314-8018-0b047a97ba89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:34.262960 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-081ebdcc-ec88-4314-8018-0b047a97ba89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:34.271442 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-081ebdcc-ec88-4314-8018-0b047a97ba89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.181216 Aug 30 07:54:34.272368 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 535/1016] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:34 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:34.500142 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-42bcb29b-95a7-4a38-8faf-67b2c9536e8e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:34.500781 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-42bcb29b-95a7-4a38-8faf-67b2c9536e8e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:34.506631 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-42bcb29b-95a7-4a38-8faf-67b2c9536e8e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:34.507077 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-42bcb29b-95a7-4a38-8faf-67b2c9536e8e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:34.508330 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-42bcb29b-95a7-4a38-8faf-67b2c9536e8e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:34.508762 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-42bcb29b-95a7-4a38-8faf-67b2c9536e8e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:34.640267 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-42bcb29b-95a7-4a38-8faf-67b2c9536e8e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:34.649490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-42bcb29b-95a7-4a38-8faf-67b2c9536e8e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:34.651033 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-42bcb29b-95a7-4a38-8faf-67b2c9536e8e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:34.652199 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-42bcb29b-95a7-4a38-8faf-67b2c9536e8e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.155842 Aug 30 07:54:34.652760 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 482/1017] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:34 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:35.290253 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3a674123-5123-4132-9e7d-7952a1eb4570 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:35.292540 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3a674123-5123-4132-9e7d-7952a1eb4570 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:35.299494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3a674123-5123-4132-9e7d-7952a1eb4570 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:35.300925 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3a674123-5123-4132-9e7d-7952a1eb4570 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:35.302247 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3a674123-5123-4132-9e7d-7952a1eb4570 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:35.303059 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3a674123-5123-4132-9e7d-7952a1eb4570 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:35.524146 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3a674123-5123-4132-9e7d-7952a1eb4570 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:35.531483 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3a674123-5123-4132-9e7d-7952a1eb4570 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.245919 Aug 30 07:54:35.532061 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 536/1018] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:35 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:35.670643 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0cb75960-d94f-4826-8f8d-18d120ca9a72 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:35.671268 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0cb75960-d94f-4826-8f8d-18d120ca9a72 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:35.677270 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0cb75960-d94f-4826-8f8d-18d120ca9a72 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:35.677719 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0cb75960-d94f-4826-8f8d-18d120ca9a72 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:35.678504 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0cb75960-d94f-4826-8f8d-18d120ca9a72 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:35.678934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0cb75960-d94f-4826-8f8d-18d120ca9a72 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:35.837889 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0cb75960-d94f-4826-8f8d-18d120ca9a72 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:35.847282 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0cb75960-d94f-4826-8f8d-18d120ca9a72 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:35.849281 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0cb75960-d94f-4826-8f8d-18d120ca9a72 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:35.850646 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0cb75960-d94f-4826-8f8d-18d120ca9a72 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.183673 Aug 30 07:54:35.851935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 483/1019] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:35 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:36.548746 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-87eca953-d402-4a63-ba77-7c5167b19a2d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:36.549525 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-87eca953-d402-4a63-ba77-7c5167b19a2d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:36.555901 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-87eca953-d402-4a63-ba77-7c5167b19a2d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:36.556316 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-87eca953-d402-4a63-ba77-7c5167b19a2d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:36.557092 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-87eca953-d402-4a63-ba77-7c5167b19a2d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:36.557534 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-87eca953-d402-4a63-ba77-7c5167b19a2d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:36.689603 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-87eca953-d402-4a63-ba77-7c5167b19a2d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:36.697655 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-87eca953-d402-4a63-ba77-7c5167b19a2d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.152707 Aug 30 07:54:36.698248 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 537/1020] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:36 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:36.872824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1328ebe7-9ca9-41ef-b6fa-cde0b228ce9b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:36.874386 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1328ebe7-9ca9-41ef-b6fa-cde0b228ce9b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:36.880526 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1328ebe7-9ca9-41ef-b6fa-cde0b228ce9b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:36.881097 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1328ebe7-9ca9-41ef-b6fa-cde0b228ce9b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:36.881985 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1328ebe7-9ca9-41ef-b6fa-cde0b228ce9b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:36.882750 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1328ebe7-9ca9-41ef-b6fa-cde0b228ce9b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:37.008294 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1328ebe7-9ca9-41ef-b6fa-cde0b228ce9b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:37.016631 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1328ebe7-9ca9-41ef-b6fa-cde0b228ce9b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:37.018117 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1328ebe7-9ca9-41ef-b6fa-cde0b228ce9b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:37.019269 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1328ebe7-9ca9-41ef-b6fa-cde0b228ce9b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.152277 Aug 30 07:54:37.019826 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 484/1021] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:36 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:54:37.714049 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c2d1281d-4bfa-404e-97a5-7a1837220a74 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:37.714610 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c2d1281d-4bfa-404e-97a5-7a1837220a74 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:37.720896 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2d1281d-4bfa-404e-97a5-7a1837220a74 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:37.721349 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2d1281d-4bfa-404e-97a5-7a1837220a74 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:37.722203 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2d1281d-4bfa-404e-97a5-7a1837220a74 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:37.722578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2d1281d-4bfa-404e-97a5-7a1837220a74 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:37.860266 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c2d1281d-4bfa-404e-97a5-7a1837220a74 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:37.868420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c2d1281d-4bfa-404e-97a5-7a1837220a74 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.158127 Aug 30 07:54:37.868986 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 538/1022] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:37 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:38.037959 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6f34fbcf-bdc3-4f7e-a9a3-4117fc4f4d20 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:38.039368 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6f34fbcf-bdc3-4f7e-a9a3-4117fc4f4d20 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:38.047290 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f34fbcf-bdc3-4f7e-a9a3-4117fc4f4d20 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:38.047748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f34fbcf-bdc3-4f7e-a9a3-4117fc4f4d20 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:38.048579 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f34fbcf-bdc3-4f7e-a9a3-4117fc4f4d20 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:38.049021 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f34fbcf-bdc3-4f7e-a9a3-4117fc4f4d20 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:38.172076 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6f34fbcf-bdc3-4f7e-a9a3-4117fc4f4d20 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:38.181369 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6f34fbcf-bdc3-4f7e-a9a3-4117fc4f4d20 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:38.183271 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6f34fbcf-bdc3-4f7e-a9a3-4117fc4f4d20 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:38.184737 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6f34fbcf-bdc3-4f7e-a9a3-4117fc4f4d20 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.150586 Aug 30 07:54:38.185656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 485/1023] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:38 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:38.885621 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1bff90bb-f104-4bf6-a614-fb24c66b0558 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:38.886275 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1bff90bb-f104-4bf6-a614-fb24c66b0558 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:38.892209 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bff90bb-f104-4bf6-a614-fb24c66b0558 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:38.892658 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bff90bb-f104-4bf6-a614-fb24c66b0558 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:38.893425 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bff90bb-f104-4bf6-a614-fb24c66b0558 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:38.893861 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bff90bb-f104-4bf6-a614-fb24c66b0558 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:39.019154 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1bff90bb-f104-4bf6-a614-fb24c66b0558 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:39.028619 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1bff90bb-f104-4bf6-a614-fb24c66b0558 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.147328 Aug 30 07:54:39.029832 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 539/1024] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:38 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:39.204253 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d003ef45-db89-4b03-ad91-33c4cbffa9ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:39.206189 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d003ef45-db89-4b03-ad91-33c4cbffa9ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:39.219260 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d003ef45-db89-4b03-ad91-33c4cbffa9ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:39.220099 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d003ef45-db89-4b03-ad91-33c4cbffa9ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:39.221658 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d003ef45-db89-4b03-ad91-33c4cbffa9ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:39.229898 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d003ef45-db89-4b03-ad91-33c4cbffa9ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:39.395176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d003ef45-db89-4b03-ad91-33c4cbffa9ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:39.404921 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d003ef45-db89-4b03-ad91-33c4cbffa9ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:39.406460 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d003ef45-db89-4b03-ad91-33c4cbffa9ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:39.407625 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d003ef45-db89-4b03-ad91-33c4cbffa9ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.208638 Aug 30 07:54:39.408192 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 486/1025] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:39 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:54:40.045432 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dbf75173-9536-4c85-a84b-f1308c77929d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:40.046091 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dbf75173-9536-4c85-a84b-f1308c77929d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:40.051855 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbf75173-9536-4c85-a84b-f1308c77929d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:40.052296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbf75173-9536-4c85-a84b-f1308c77929d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:40.053052 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbf75173-9536-4c85-a84b-f1308c77929d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:40.053480 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbf75173-9536-4c85-a84b-f1308c77929d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:40.172093 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-dbf75173-9536-4c85-a84b-f1308c77929d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:40.179898 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dbf75173-9536-4c85-a84b-f1308c77929d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.137424 Aug 30 07:54:40.180667 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 540/1026] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:40 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:40.431987 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b9743dd0-c1ea-4338-9580-2781f80a7b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:40.432842 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b9743dd0-c1ea-4338-9580-2781f80a7b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:40.439502 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b9743dd0-c1ea-4338-9580-2781f80a7b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:40.440050 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b9743dd0-c1ea-4338-9580-2781f80a7b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:40.441014 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b9743dd0-c1ea-4338-9580-2781f80a7b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:40.441459 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b9743dd0-c1ea-4338-9580-2781f80a7b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:40.575601 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b9743dd0-c1ea-4338-9580-2781f80a7b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:40.583893 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b9743dd0-c1ea-4338-9580-2781f80a7b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:40.585419 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b9743dd0-c1ea-4338-9580-2781f80a7b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:40.586619 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b9743dd0-c1ea-4338-9580-2781f80a7b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.159793 Aug 30 07:54:40.587955 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 487/1027] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:40 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:41.196495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-54ec39b0-0f3a-4488-86a1-87c4c31a96eb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:41.197124 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-54ec39b0-0f3a-4488-86a1-87c4c31a96eb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:41.203919 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54ec39b0-0f3a-4488-86a1-87c4c31a96eb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:41.204370 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54ec39b0-0f3a-4488-86a1-87c4c31a96eb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:41.205134 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54ec39b0-0f3a-4488-86a1-87c4c31a96eb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:41.205565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54ec39b0-0f3a-4488-86a1-87c4c31a96eb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:41.340859 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-54ec39b0-0f3a-4488-86a1-87c4c31a96eb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:41.348346 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-54ec39b0-0f3a-4488-86a1-87c4c31a96eb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.155600 Aug 30 07:54:41.348917 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 541/1028] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:41 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:54:41.606883 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0eb08c3d-c01a-4b74-93fe-c9744041a755 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:41.607605 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0eb08c3d-c01a-4b74-93fe-c9744041a755 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:41.613725 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0eb08c3d-c01a-4b74-93fe-c9744041a755 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:41.614196 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0eb08c3d-c01a-4b74-93fe-c9744041a755 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:41.614964 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0eb08c3d-c01a-4b74-93fe-c9744041a755 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:41.615394 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0eb08c3d-c01a-4b74-93fe-c9744041a755 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:41.746702 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0eb08c3d-c01a-4b74-93fe-c9744041a755 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:41.754854 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0eb08c3d-c01a-4b74-93fe-c9744041a755 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:41.756335 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0eb08c3d-c01a-4b74-93fe-c9744041a755 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:41.757460 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0eb08c3d-c01a-4b74-93fe-c9744041a755 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.154918 Aug 30 07:54:41.758022 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 488/1029] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:41 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:42.365050 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7a4f540b-11bc-4b27-b40c-d57e1bc063bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:42.365703 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7a4f540b-11bc-4b27-b40c-d57e1bc063bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:42.377531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7a4f540b-11bc-4b27-b40c-d57e1bc063bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:42.379160 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7a4f540b-11bc-4b27-b40c-d57e1bc063bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:42.380231 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7a4f540b-11bc-4b27-b40c-d57e1bc063bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:42.380893 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7a4f540b-11bc-4b27-b40c-d57e1bc063bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:42.529556 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7a4f540b-11bc-4b27-b40c-d57e1bc063bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:42.538469 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7a4f540b-11bc-4b27-b40c-d57e1bc063bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.177288 Aug 30 07:54:42.547176 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 542/1030] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:42 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:42.775404 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9b5fb195-7bbc-440d-9786-e3eb5a21f91d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:42.775977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9b5fb195-7bbc-440d-9786-e3eb5a21f91d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:42.781754 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b5fb195-7bbc-440d-9786-e3eb5a21f91d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:42.782233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b5fb195-7bbc-440d-9786-e3eb5a21f91d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:42.782998 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b5fb195-7bbc-440d-9786-e3eb5a21f91d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:42.783433 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b5fb195-7bbc-440d-9786-e3eb5a21f91d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:42.934479 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9b5fb195-7bbc-440d-9786-e3eb5a21f91d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:42.942933 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9b5fb195-7bbc-440d-9786-e3eb5a21f91d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:42.944445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9b5fb195-7bbc-440d-9786-e3eb5a21f91d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:42.945591 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9b5fb195-7bbc-440d-9786-e3eb5a21f91d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.174010 Aug 30 07:54:42.946175 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 489/1031] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:42 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:43.555736 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0f269468-042c-4262-bce8-dc77aa056ff9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:43.556379 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0f269468-042c-4262-bce8-dc77aa056ff9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:43.562627 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0f269468-042c-4262-bce8-dc77aa056ff9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:43.563071 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0f269468-042c-4262-bce8-dc77aa056ff9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:43.563837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0f269468-042c-4262-bce8-dc77aa056ff9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:43.564271 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0f269468-042c-4262-bce8-dc77aa056ff9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:43.693377 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0f269468-042c-4262-bce8-dc77aa056ff9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:43.701173 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0f269468-042c-4262-bce8-dc77aa056ff9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.149031 Aug 30 07:54:43.710629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 543/1032] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:43 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:43.964358 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-08bd962b-8868-4da2-8e0d-0a4d23b5bf29 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:43.964970 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-08bd962b-8868-4da2-8e0d-0a4d23b5bf29 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:43.971004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-08bd962b-8868-4da2-8e0d-0a4d23b5bf29 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:43.971450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-08bd962b-8868-4da2-8e0d-0a4d23b5bf29 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:43.972218 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-08bd962b-8868-4da2-8e0d-0a4d23b5bf29 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:43.972650 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-08bd962b-8868-4da2-8e0d-0a4d23b5bf29 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:44.099321 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-08bd962b-8868-4da2-8e0d-0a4d23b5bf29 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:44.108298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-08bd962b-8868-4da2-8e0d-0a4d23b5bf29 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:44.109793 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-08bd962b-8868-4da2-8e0d-0a4d23b5bf29 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:44.110967 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-08bd962b-8868-4da2-8e0d-0a4d23b5bf29 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.150630 Aug 30 07:54:44.111520 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 490/1033] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:43 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:44.717952 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7f1ed5f0-e8a0-4bd2-9925-92fefd287c89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:44.718587 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7f1ed5f0-e8a0-4bd2-9925-92fefd287c89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:44.724461 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f1ed5f0-e8a0-4bd2-9925-92fefd287c89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:44.724902 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f1ed5f0-e8a0-4bd2-9925-92fefd287c89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:44.725646 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f1ed5f0-e8a0-4bd2-9925-92fefd287c89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:44.726069 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f1ed5f0-e8a0-4bd2-9925-92fefd287c89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:44.848105 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7f1ed5f0-e8a0-4bd2-9925-92fefd287c89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:44.855597 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7f1ed5f0-e8a0-4bd2-9925-92fefd287c89 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.141921 Aug 30 07:54:44.856166 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 544/1034] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:44 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:45.129721 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b036f6c4-6506-437e-a767-90692aab7836 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:45.130361 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b036f6c4-6506-437e-a767-90692aab7836 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:45.136868 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b036f6c4-6506-437e-a767-90692aab7836 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:45.137308 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b036f6c4-6506-437e-a767-90692aab7836 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:45.138064 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b036f6c4-6506-437e-a767-90692aab7836 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:45.139156 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b036f6c4-6506-437e-a767-90692aab7836 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:45.261329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b036f6c4-6506-437e-a767-90692aab7836 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:45.269540 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b036f6c4-6506-437e-a767-90692aab7836 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:45.271082 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b036f6c4-6506-437e-a767-90692aab7836 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:45.272220 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b036f6c4-6506-437e-a767-90692aab7836 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.146153 Aug 30 07:54:45.272785 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 491/1035] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:45 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:45.872625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8748bad6-29e1-4048-990e-ac3f09265cf1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:45.873251 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8748bad6-29e1-4048-990e-ac3f09265cf1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:45.879090 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8748bad6-29e1-4048-990e-ac3f09265cf1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:45.879530 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8748bad6-29e1-4048-990e-ac3f09265cf1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:45.880290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8748bad6-29e1-4048-990e-ac3f09265cf1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:45.880713 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8748bad6-29e1-4048-990e-ac3f09265cf1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:46.242553 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8748bad6-29e1-4048-990e-ac3f09265cf1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:46.250448 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8748bad6-29e1-4048-990e-ac3f09265cf1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.381459 Aug 30 07:54:46.251008 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 545/1036] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:45 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:46.289535 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1e4f9db1-af40-42a6-abfd-455786e41bc5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:46.290231 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1e4f9db1-af40-42a6-abfd-455786e41bc5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:46.295990 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1e4f9db1-af40-42a6-abfd-455786e41bc5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:46.296450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1e4f9db1-af40-42a6-abfd-455786e41bc5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:46.297180 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1e4f9db1-af40-42a6-abfd-455786e41bc5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:46.297607 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1e4f9db1-af40-42a6-abfd-455786e41bc5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:46.420132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1e4f9db1-af40-42a6-abfd-455786e41bc5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:46.427217 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1e4f9db1-af40-42a6-abfd-455786e41bc5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:46.428692 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1e4f9db1-af40-42a6-abfd-455786e41bc5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:46.429823 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1e4f9db1-af40-42a6-abfd-455786e41bc5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.144097 Aug 30 07:54:46.430430 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 492/1037] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:46 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:54:47.268641 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-35edef64-1d19-4561-8c76-6c6a70cde9de tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:47.269258 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-35edef64-1d19-4561-8c76-6c6a70cde9de tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:47.275066 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35edef64-1d19-4561-8c76-6c6a70cde9de tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:47.276050 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35edef64-1d19-4561-8c76-6c6a70cde9de tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:47.276832 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35edef64-1d19-4561-8c76-6c6a70cde9de tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:47.277267 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35edef64-1d19-4561-8c76-6c6a70cde9de tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:47.399288 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-35edef64-1d19-4561-8c76-6c6a70cde9de tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:47.408243 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-35edef64-1d19-4561-8c76-6c6a70cde9de tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.142863 Aug 30 07:54:47.408558 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 546/1038] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:47 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:47.446971 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7812aaa2-2aea-42cc-bfa8-6c5dc751ba2d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:47.447620 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7812aaa2-2aea-42cc-bfa8-6c5dc751ba2d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:47.453355 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7812aaa2-2aea-42cc-bfa8-6c5dc751ba2d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:47.453799 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7812aaa2-2aea-42cc-bfa8-6c5dc751ba2d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:47.454699 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7812aaa2-2aea-42cc-bfa8-6c5dc751ba2d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:47.455146 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7812aaa2-2aea-42cc-bfa8-6c5dc751ba2d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:48.004781 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7812aaa2-2aea-42cc-bfa8-6c5dc751ba2d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:48.013700 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7812aaa2-2aea-42cc-bfa8-6c5dc751ba2d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:48.015204 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7812aaa2-2aea-42cc-bfa8-6c5dc751ba2d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:48.016339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7812aaa2-2aea-42cc-bfa8-6c5dc751ba2d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.573167 Aug 30 07:54:48.016954 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 493/1039] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:47 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:48.185579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-252526a1-cf81-4f8d-a2f7-ac614074201a req-7ab2fcbd-823d-4403-b6cb-a21a77a1c4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35", "tag": "17a5b7fe-6ea4-4a61-995f-35648fa60831"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:54:48.186857 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:54:48.186857 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:54:48.196374 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-252526a1-cf81-4f8d-a2f7-ac614074201a req-7ab2fcbd-823d-4403-b6cb-a21a77a1c4dc service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:48.201823 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-252526a1-cf81-4f8d-a2f7-ac614074201a req-7ab2fcbd-823d-4403-b6cb-a21a77a1c4dc service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:48.214791 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-252526a1-cf81-4f8d-a2f7-ac614074201a req-7ab2fcbd-823d-4403-b6cb-a21a77a1c4dc service nova] Creating event network-changed:17a5b7fe-6ea4-4a61-995f-35648fa60831 for instance c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 on hv-cinder-80619 Aug 30 07:54:48.221513 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-252526a1-cf81-4f8d-a2f7-ac614074201a req-7ab2fcbd-823d-4403-b6cb-a21a77a1c4dc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045145 Aug 30 07:54:48.222219 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 547/1040] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:54:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:54:48.424525 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7a04dd7c-86b0-4386-bd75-7d1802d91acd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:48.425652 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7a04dd7c-86b0-4386-bd75-7d1802d91acd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:48.431157 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7a04dd7c-86b0-4386-bd75-7d1802d91acd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:48.431632 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7a04dd7c-86b0-4386-bd75-7d1802d91acd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:48.432637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7a04dd7c-86b0-4386-bd75-7d1802d91acd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:48.433074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7a04dd7c-86b0-4386-bd75-7d1802d91acd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:48.626705 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7a04dd7c-86b0-4386-bd75-7d1802d91acd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:48.636318 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7a04dd7c-86b0-4386-bd75-7d1802d91acd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.215318 Aug 30 07:54:48.647182 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 494/1041] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:48 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:49.035272 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-aa9eb0d0-3de3-4e27-8163-0aa5f99f3c78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:49.035960 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-aa9eb0d0-3de3-4e27-8163-0aa5f99f3c78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:49.042499 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa9eb0d0-3de3-4e27-8163-0aa5f99f3c78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:49.042944 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa9eb0d0-3de3-4e27-8163-0aa5f99f3c78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:49.043717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa9eb0d0-3de3-4e27-8163-0aa5f99f3c78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:49.044143 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa9eb0d0-3de3-4e27-8163-0aa5f99f3c78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:49.183066 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-aa9eb0d0-3de3-4e27-8163-0aa5f99f3c78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:49.191690 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-aa9eb0d0-3de3-4e27-8163-0aa5f99f3c78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:49.193205 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-aa9eb0d0-3de3-4e27-8163-0aa5f99f3c78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:49.194400 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-aa9eb0d0-3de3-4e27-8163-0aa5f99f3c78 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.163246 Aug 30 07:54:49.194960 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 548/1042] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:49 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:49.654046 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-100e69ab-6c07-4362-bb0a-fe6ce4abe46b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:49.654731 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-100e69ab-6c07-4362-bb0a-fe6ce4abe46b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:49.660461 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-100e69ab-6c07-4362-bb0a-fe6ce4abe46b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:49.660906 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-100e69ab-6c07-4362-bb0a-fe6ce4abe46b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:49.661662 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-100e69ab-6c07-4362-bb0a-fe6ce4abe46b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:49.662094 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-100e69ab-6c07-4362-bb0a-fe6ce4abe46b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:49.786502 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-100e69ab-6c07-4362-bb0a-fe6ce4abe46b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:49.795533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-100e69ab-6c07-4362-bb0a-fe6ce4abe46b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.145835 Aug 30 07:54:49.796109 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 495/1043] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:49 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:50.213628 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1df61f95-5560-42b7-8af5-f4beddefe71f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:50.214572 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1df61f95-5560-42b7-8af5-f4beddefe71f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:50.224268 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1df61f95-5560-42b7-8af5-f4beddefe71f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:50.228618 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1df61f95-5560-42b7-8af5-f4beddefe71f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:50.229382 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1df61f95-5560-42b7-8af5-f4beddefe71f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:50.229927 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1df61f95-5560-42b7-8af5-f4beddefe71f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:50.362606 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1df61f95-5560-42b7-8af5-f4beddefe71f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:50.371678 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1df61f95-5560-42b7-8af5-f4beddefe71f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:50.373184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1df61f95-5560-42b7-8af5-f4beddefe71f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:50.374410 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1df61f95-5560-42b7-8af5-f4beddefe71f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.165226 Aug 30 07:54:50.375052 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 549/1044] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:50 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:50.812414 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-32c4b197-e327-4ba0-90c7-1a43821db648 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:50.813039 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-32c4b197-e327-4ba0-90c7-1a43821db648 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:50.819194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-32c4b197-e327-4ba0-90c7-1a43821db648 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:50.819639 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-32c4b197-e327-4ba0-90c7-1a43821db648 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:50.820429 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-32c4b197-e327-4ba0-90c7-1a43821db648 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:50.820869 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-32c4b197-e327-4ba0-90c7-1a43821db648 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:50.956161 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-32c4b197-e327-4ba0-90c7-1a43821db648 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:50.963443 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-32c4b197-e327-4ba0-90c7-1a43821db648 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.154330 Aug 30 07:54:50.964223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 496/1045] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:50 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:51.394129 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c5f349f8-783f-457f-b282-2734043e62bd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:51.394766 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c5f349f8-783f-457f-b282-2734043e62bd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:51.401978 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5f349f8-783f-457f-b282-2734043e62bd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:51.402757 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5f349f8-783f-457f-b282-2734043e62bd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:51.403642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5f349f8-783f-457f-b282-2734043e62bd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:51.404077 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5f349f8-783f-457f-b282-2734043e62bd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:51.537428 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c5f349f8-783f-457f-b282-2734043e62bd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:51.542125 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c5f349f8-783f-457f-b282-2734043e62bd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:51.543712 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c5f349f8-783f-457f-b282-2734043e62bd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:51.551733 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c5f349f8-783f-457f-b282-2734043e62bd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.161131 Aug 30 07:54:51.552814 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 550/1046] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:51 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:51.979768 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-534fbbb5-c3a8-4810-9d5c-94bbe917b8d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:51.980364 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-534fbbb5-c3a8-4810-9d5c-94bbe917b8d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:51.986329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-534fbbb5-c3a8-4810-9d5c-94bbe917b8d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:51.987039 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-534fbbb5-c3a8-4810-9d5c-94bbe917b8d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:51.987789 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-534fbbb5-c3a8-4810-9d5c-94bbe917b8d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:51.988218 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-534fbbb5-c3a8-4810-9d5c-94bbe917b8d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:52.118171 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-534fbbb5-c3a8-4810-9d5c-94bbe917b8d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:52.126199 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-534fbbb5-c3a8-4810-9d5c-94bbe917b8d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.150027 Aug 30 07:54:52.126964 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 497/1047] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:51 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:52.572539 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7eac4051-504a-4ecc-8de7-261da26d3704 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:52.573145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7eac4051-504a-4ecc-8de7-261da26d3704 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:52.581632 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7eac4051-504a-4ecc-8de7-261da26d3704 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:52.582115 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7eac4051-504a-4ecc-8de7-261da26d3704 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:52.582885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7eac4051-504a-4ecc-8de7-261da26d3704 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:52.583371 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7eac4051-504a-4ecc-8de7-261da26d3704 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:52.715494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7eac4051-504a-4ecc-8de7-261da26d3704 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:52.723797 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7eac4051-504a-4ecc-8de7-261da26d3704 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:52.725279 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7eac4051-504a-4ecc-8de7-261da26d3704 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:52.726442 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7eac4051-504a-4ecc-8de7-261da26d3704 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.157694 Aug 30 07:54:52.727001 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 551/1048] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:52 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:53.142774 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8c085bb2-ceaf-4696-9071-acead3b4f11b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:53.143388 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8c085bb2-ceaf-4696-9071-acead3b4f11b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:53.149460 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8c085bb2-ceaf-4696-9071-acead3b4f11b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:53.150702 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8c085bb2-ceaf-4696-9071-acead3b4f11b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:53.151537 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8c085bb2-ceaf-4696-9071-acead3b4f11b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:53.151975 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8c085bb2-ceaf-4696-9071-acead3b4f11b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:53.277290 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8c085bb2-ceaf-4696-9071-acead3b4f11b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:53.284884 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8c085bb2-ceaf-4696-9071-acead3b4f11b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.145808 Aug 30 07:54:53.285524 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 498/1049] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:53 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:53.745690 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d753ec45-37f8-455d-a259-4371b2f3b248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:53.746876 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d753ec45-37f8-455d-a259-4371b2f3b248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:53.753123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d753ec45-37f8-455d-a259-4371b2f3b248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:53.753808 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d753ec45-37f8-455d-a259-4371b2f3b248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:53.755418 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d753ec45-37f8-455d-a259-4371b2f3b248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:53.755854 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d753ec45-37f8-455d-a259-4371b2f3b248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:53.881430 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d753ec45-37f8-455d-a259-4371b2f3b248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:53.891341 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d753ec45-37f8-455d-a259-4371b2f3b248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:53.892837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d753ec45-37f8-455d-a259-4371b2f3b248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:53.893993 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d753ec45-37f8-455d-a259-4371b2f3b248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.153006 Aug 30 07:54:53.894633 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 552/1050] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:53 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:54:54.302090 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3e7675d7-81c8-4fa3-8fed-9005a83b2a28 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:54.302758 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3e7675d7-81c8-4fa3-8fed-9005a83b2a28 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:54.309296 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3e7675d7-81c8-4fa3-8fed-9005a83b2a28 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:54.309739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3e7675d7-81c8-4fa3-8fed-9005a83b2a28 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:54.310545 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3e7675d7-81c8-4fa3-8fed-9005a83b2a28 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:54.310974 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3e7675d7-81c8-4fa3-8fed-9005a83b2a28 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:54.440986 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3e7675d7-81c8-4fa3-8fed-9005a83b2a28 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:54.448594 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3e7675d7-81c8-4fa3-8fed-9005a83b2a28 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.150147 Aug 30 07:54:54.449176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 499/1051] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:54 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:54.912373 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9e8142fe-0ca3-4651-af40-7fd6932e9a51 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:54.913190 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9e8142fe-0ca3-4651-af40-7fd6932e9a51 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:54.919624 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9e8142fe-0ca3-4651-af40-7fd6932e9a51 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:54.920074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9e8142fe-0ca3-4651-af40-7fd6932e9a51 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:54.920849 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9e8142fe-0ca3-4651-af40-7fd6932e9a51 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:54.921285 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9e8142fe-0ca3-4651-af40-7fd6932e9a51 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:55.045608 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9e8142fe-0ca3-4651-af40-7fd6932e9a51 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:55.053911 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9e8142fe-0ca3-4651-af40-7fd6932e9a51 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:55.055445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9e8142fe-0ca3-4651-af40-7fd6932e9a51 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:55.056973 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9e8142fe-0ca3-4651-af40-7fd6932e9a51 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.148079 Aug 30 07:54:55.057552 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 553/1052] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:54 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:54:55.468273 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6888d7e2-29fd-4d8f-8144-47aca5b1476b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:55.469270 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6888d7e2-29fd-4d8f-8144-47aca5b1476b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:55.478603 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6888d7e2-29fd-4d8f-8144-47aca5b1476b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:55.479317 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6888d7e2-29fd-4d8f-8144-47aca5b1476b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:55.480556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6888d7e2-29fd-4d8f-8144-47aca5b1476b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:55.481544 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6888d7e2-29fd-4d8f-8144-47aca5b1476b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:55.625970 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6888d7e2-29fd-4d8f-8144-47aca5b1476b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:55.633827 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6888d7e2-29fd-4d8f-8144-47aca5b1476b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.172173 Aug 30 07:54:55.635116 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 500/1053] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:55 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:56.075230 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9befa107-749f-4031-9ba2-08f4c42ab3b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:56.075848 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9befa107-749f-4031-9ba2-08f4c42ab3b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:56.081884 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9befa107-749f-4031-9ba2-08f4c42ab3b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:56.082677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9befa107-749f-4031-9ba2-08f4c42ab3b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:56.083516 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9befa107-749f-4031-9ba2-08f4c42ab3b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:56.083972 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9befa107-749f-4031-9ba2-08f4c42ab3b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:56.214468 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9befa107-749f-4031-9ba2-08f4c42ab3b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:56.223996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9befa107-749f-4031-9ba2-08f4c42ab3b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:56.225569 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9befa107-749f-4031-9ba2-08f4c42ab3b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:56.227204 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9befa107-749f-4031-9ba2-08f4c42ab3b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.155813 Aug 30 07:54:56.234193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 554/1054] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:56 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:56.650793 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-87712e5c-0475-49d1-bdcb-cf8d94627970 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:56.651615 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-87712e5c-0475-49d1-bdcb-cf8d94627970 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:56.658700 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-87712e5c-0475-49d1-bdcb-cf8d94627970 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:56.659251 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-87712e5c-0475-49d1-bdcb-cf8d94627970 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:56.660096 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-87712e5c-0475-49d1-bdcb-cf8d94627970 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:56.660596 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-87712e5c-0475-49d1-bdcb-cf8d94627970 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:56.797109 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-87712e5c-0475-49d1-bdcb-cf8d94627970 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:56.804170 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-87712e5c-0475-49d1-bdcb-cf8d94627970 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.157546 Aug 30 07:54:56.804733 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 501/1055] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:56 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:57.247467 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-01efd395-ec88-417a-9094-a1f0f550b6fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:57.248135 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-01efd395-ec88-417a-9094-a1f0f550b6fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:57.254050 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01efd395-ec88-417a-9094-a1f0f550b6fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:57.254523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01efd395-ec88-417a-9094-a1f0f550b6fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:57.255295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01efd395-ec88-417a-9094-a1f0f550b6fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:57.255723 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01efd395-ec88-417a-9094-a1f0f550b6fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:57.381150 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-01efd395-ec88-417a-9094-a1f0f550b6fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:57.390606 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-01efd395-ec88-417a-9094-a1f0f550b6fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:57.392106 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-01efd395-ec88-417a-9094-a1f0f550b6fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:57.393251 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-01efd395-ec88-417a-9094-a1f0f550b6fc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.150890 Aug 30 07:54:57.393813 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 555/1056] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:57 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:57.820671 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9075d62f-c566-4c81-85be-23530ff3cf7f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:57.821393 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9075d62f-c566-4c81-85be-23530ff3cf7f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:57.827283 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9075d62f-c566-4c81-85be-23530ff3cf7f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:57.827729 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9075d62f-c566-4c81-85be-23530ff3cf7f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:57.828490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9075d62f-c566-4c81-85be-23530ff3cf7f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:57.828922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9075d62f-c566-4c81-85be-23530ff3cf7f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:57.983219 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9075d62f-c566-4c81-85be-23530ff3cf7f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:57.991821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9075d62f-c566-4c81-85be-23530ff3cf7f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.174800 Aug 30 07:54:57.992399 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 502/1057] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:57 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:54:58.413345 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-35e13e37-a68f-4c01-a8a5-1e945be1eb80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:58.414203 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-35e13e37-a68f-4c01-a8a5-1e945be1eb80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:58.423048 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35e13e37-a68f-4c01-a8a5-1e945be1eb80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:58.423763 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35e13e37-a68f-4c01-a8a5-1e945be1eb80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:58.425051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35e13e37-a68f-4c01-a8a5-1e945be1eb80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:58.425971 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35e13e37-a68f-4c01-a8a5-1e945be1eb80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:58.568492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-35e13e37-a68f-4c01-a8a5-1e945be1eb80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:58.577483 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-35e13e37-a68f-4c01-a8a5-1e945be1eb80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:58.579210 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-35e13e37-a68f-4c01-a8a5-1e945be1eb80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:58.580415 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-35e13e37-a68f-4c01-a8a5-1e945be1eb80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.171030 Aug 30 07:54:58.580989 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 556/1058] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:58 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:54:59.009483 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e885a7a0-b6f6-4818-bf08-18c72e5ddd43 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:59.010577 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e885a7a0-b6f6-4818-bf08-18c72e5ddd43 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:59.017047 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e885a7a0-b6f6-4818-bf08-18c72e5ddd43 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:59.017601 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e885a7a0-b6f6-4818-bf08-18c72e5ddd43 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:59.018729 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e885a7a0-b6f6-4818-bf08-18c72e5ddd43 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:59.018923 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e885a7a0-b6f6-4818-bf08-18c72e5ddd43 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:59.160461 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e885a7a0-b6f6-4818-bf08-18c72e5ddd43 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:59.169926 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e885a7a0-b6f6-4818-bf08-18c72e5ddd43 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.164734 Aug 30 07:54:59.170536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 503/1059] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:54:59 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:54:59.599193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d4149575-aeea-4ea7-955c-7094bc1a1f2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:54:59.599889 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d4149575-aeea-4ea7-955c-7094bc1a1f2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:54:59.605934 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4149575-aeea-4ea7-955c-7094bc1a1f2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:59.606416 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4149575-aeea-4ea7-955c-7094bc1a1f2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:59.607181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4149575-aeea-4ea7-955c-7094bc1a1f2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:54:59.607642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d4149575-aeea-4ea7-955c-7094bc1a1f2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:54:59.733822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d4149575-aeea-4ea7-955c-7094bc1a1f2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:59.742569 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d4149575-aeea-4ea7-955c-7094bc1a1f2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:59.744204 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d4149575-aeea-4ea7-955c-7094bc1a1f2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:54:59.745353 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d4149575-aeea-4ea7-955c-7094bc1a1f2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.149960 Aug 30 07:54:59.745900 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 557/1060] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:54:59 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:00.186708 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4405f0a1-de10-4c70-9ca5-e5825fad163d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:00.187315 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4405f0a1-de10-4c70-9ca5-e5825fad163d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:00.193156 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4405f0a1-de10-4c70-9ca5-e5825fad163d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:00.193615 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4405f0a1-de10-4c70-9ca5-e5825fad163d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:00.194432 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4405f0a1-de10-4c70-9ca5-e5825fad163d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:00.194874 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4405f0a1-de10-4c70-9ca5-e5825fad163d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:00.315972 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4405f0a1-de10-4c70-9ca5-e5825fad163d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:00.323882 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4405f0a1-de10-4c70-9ca5-e5825fad163d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.140880 Aug 30 07:55:00.324449 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 504/1061] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:00 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:00.763110 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3521a847-078b-45d3-bffe-cc1fa33408e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:00.763696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3521a847-078b-45d3-bffe-cc1fa33408e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:00.769522 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3521a847-078b-45d3-bffe-cc1fa33408e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:00.769958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3521a847-078b-45d3-bffe-cc1fa33408e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:00.770748 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3521a847-078b-45d3-bffe-cc1fa33408e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:00.771177 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3521a847-078b-45d3-bffe-cc1fa33408e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:00.890050 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3521a847-078b-45d3-bffe-cc1fa33408e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:00.898401 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3521a847-078b-45d3-bffe-cc1fa33408e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:00.900104 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3521a847-078b-45d3-bffe-cc1fa33408e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:00.901246 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3521a847-078b-45d3-bffe-cc1fa33408e7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.142489 Aug 30 07:55:00.901805 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 558/1062] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:00 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:01.340370 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fb511011-4085-42d9-aec8-d7b2fb59193a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:01.341007 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fb511011-4085-42d9-aec8-d7b2fb59193a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:01.346838 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fb511011-4085-42d9-aec8-d7b2fb59193a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:01.347287 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fb511011-4085-42d9-aec8-d7b2fb59193a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:01.348078 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fb511011-4085-42d9-aec8-d7b2fb59193a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:01.348514 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fb511011-4085-42d9-aec8-d7b2fb59193a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:01.472024 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-fb511011-4085-42d9-aec8-d7b2fb59193a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:01.479692 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fb511011-4085-42d9-aec8-d7b2fb59193a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.142993 Aug 30 07:55:01.480252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 505/1063] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:01 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:01.919120 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4bc1cc42-522d-406d-980c-b0704f312a80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:01.919730 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4bc1cc42-522d-406d-980c-b0704f312a80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:01.925611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4bc1cc42-522d-406d-980c-b0704f312a80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:01.926057 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4bc1cc42-522d-406d-980c-b0704f312a80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:01.926843 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4bc1cc42-522d-406d-980c-b0704f312a80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:01.927277 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4bc1cc42-522d-406d-980c-b0704f312a80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:02.046762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4bc1cc42-522d-406d-980c-b0704f312a80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:02.054843 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4bc1cc42-522d-406d-980c-b0704f312a80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:02.056335 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4bc1cc42-522d-406d-980c-b0704f312a80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:02.057462 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4bc1cc42-522d-406d-980c-b0704f312a80 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.142055 Aug 30 07:55:02.058026 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 559/1064] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:01 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:02.496089 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-02dea513-be76-410a-af68-8501cff12a21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:02.496694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-02dea513-be76-410a-af68-8501cff12a21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:02.502527 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-02dea513-be76-410a-af68-8501cff12a21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:02.502971 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-02dea513-be76-410a-af68-8501cff12a21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:02.503728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-02dea513-be76-410a-af68-8501cff12a21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:02.504158 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-02dea513-be76-410a-af68-8501cff12a21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:02.748066 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-02dea513-be76-410a-af68-8501cff12a21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:02.755966 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-02dea513-be76-410a-af68-8501cff12a21 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.263996 Aug 30 07:55:02.756543 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 506/1065] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:02 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:03.075799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d55709b0-cb5b-47ca-a249-02918c09d9b6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:03.076420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d55709b0-cb5b-47ca-a249-02918c09d9b6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:03.082252 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d55709b0-cb5b-47ca-a249-02918c09d9b6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:03.082724 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d55709b0-cb5b-47ca-a249-02918c09d9b6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:03.083459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d55709b0-cb5b-47ca-a249-02918c09d9b6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:03.083894 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d55709b0-cb5b-47ca-a249-02918c09d9b6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:03.208692 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d55709b0-cb5b-47ca-a249-02918c09d9b6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:03.217581 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d55709b0-cb5b-47ca-a249-02918c09d9b6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:03.219097 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d55709b0-cb5b-47ca-a249-02918c09d9b6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:03.220237 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d55709b0-cb5b-47ca-a249-02918c09d9b6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.148397 Aug 30 07:55:03.220797 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 560/1066] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:03 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:03.708415 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1d53e772-490c-4ce7-9bda-1ef7b5bb5d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:03.708999 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1d53e772-490c-4ce7-9bda-1ef7b5bb5d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:03.715677 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1d53e772-490c-4ce7-9bda-1ef7b5bb5d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:03.716120 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1d53e772-490c-4ce7-9bda-1ef7b5bb5d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:03.716880 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1d53e772-490c-4ce7-9bda-1ef7b5bb5d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:03.717315 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1d53e772-490c-4ce7-9bda-1ef7b5bb5d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:03.771687 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5ab41795-06cf-4890-be93-30965ef8433f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:03.772301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5ab41795-06cf-4890-be93-30965ef8433f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:03.777964 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ab41795-06cf-4890-be93-30965ef8433f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:03.778440 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ab41795-06cf-4890-be93-30965ef8433f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:03.779195 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ab41795-06cf-4890-be93-30965ef8433f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:03.779625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5ab41795-06cf-4890-be93-30965ef8433f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:03.799615 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-1d53e772-490c-4ce7-9bda-1ef7b5bb5d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lazy-loading 'services' on Instance uuid 63042c8c-43ca-4d02-8ef2-07a08833cdf1 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:55:03.866858 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1d53e772-490c-4ce7-9bda-1ef7b5bb5d58 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "DELETE /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/os-volume_attachments/c6e84f33-2244-4d9f-ad9b-5b56a4b7cd66" status: 202 len: 0 microversion: 2.1 time: 0.160829 Aug 30 07:55:03.867510 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 507/1067] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:55:03 2021] DELETE /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/os-volume_attachments/c6e84f33-2244-4d9f-ad9b-5b56a4b7cd66 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:55:03.919892 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5ab41795-06cf-4890-be93-30965ef8433f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:03.932977 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5ab41795-06cf-4890-be93-30965ef8433f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.164755 Aug 30 07:55:03.934076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 561/1068] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:03 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:55:04.240674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9845a5fa-1e2e-48a4-9c7f-5fb3f840f409 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:04.241394 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9845a5fa-1e2e-48a4-9c7f-5fb3f840f409 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:04.248148 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9845a5fa-1e2e-48a4-9c7f-5fb3f840f409 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:04.248591 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9845a5fa-1e2e-48a4-9c7f-5fb3f840f409 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:04.249354 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9845a5fa-1e2e-48a4-9c7f-5fb3f840f409 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:04.249784 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9845a5fa-1e2e-48a4-9c7f-5fb3f840f409 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:04.377682 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9845a5fa-1e2e-48a4-9c7f-5fb3f840f409 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:04.385890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9845a5fa-1e2e-48a4-9c7f-5fb3f840f409 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:04.387401 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9845a5fa-1e2e-48a4-9c7f-5fb3f840f409 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:04.388522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9845a5fa-1e2e-48a4-9c7f-5fb3f840f409 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.152801 Aug 30 07:55:04.389081 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 508/1069] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:04 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:04.950735 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fcc09cc5-f259-4fa0-b33d-8830ab912606 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:04.951350 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fcc09cc5-f259-4fa0-b33d-8830ab912606 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:04.957303 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fcc09cc5-f259-4fa0-b33d-8830ab912606 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:04.957748 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fcc09cc5-f259-4fa0-b33d-8830ab912606 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:04.958554 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fcc09cc5-f259-4fa0-b33d-8830ab912606 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:04.958989 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fcc09cc5-f259-4fa0-b33d-8830ab912606 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:04.996403 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-90a227b9-124d-4f00-8757-7d97c8ff25e7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:55:05.002412 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-90a227b9-124d-4f00-8757-7d97c8ff25e7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:05.002858 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-90a227b9-124d-4f00-8757-7d97c8ff25e7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:05.025024 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-90a227b9-124d-4f00-8757-7d97c8ff25e7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Going to try to stop instance {{(pid=114670) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 30 07:55:05.068599 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-90a227b9-124d-4f00-8757-7d97c8ff25e7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 202 len: 0 microversion: 2.1 time: 0.076349 Aug 30 07:55:05.069329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 509/1070] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:55:04 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:55:05.078542 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2068d07d-b677-48aa-bc83-e009584d8bfa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:05.078777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2068d07d-b677-48aa-bc83-e009584d8bfa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:05.085189 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2068d07d-b677-48aa-bc83-e009584d8bfa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:05.085748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2068d07d-b677-48aa-bc83-e009584d8bfa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:05.086705 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2068d07d-b677-48aa-bc83-e009584d8bfa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:05.087234 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2068d07d-b677-48aa-bc83-e009584d8bfa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:05.087385 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-fcc09cc5-f259-4fa0-b33d-8830ab912606 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:05.097916 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fcc09cc5-f259-4fa0-b33d-8830ab912606 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.150745 Aug 30 07:55:05.107964 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 562/1071] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:04 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:05.216566 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2068d07d-b677-48aa-bc83-e009584d8bfa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:05.223887 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2068d07d-b677-48aa-bc83-e009584d8bfa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.149798 Aug 30 07:55:05.224451 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 510/1072] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:05 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:05.406682 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8de094b1-105a-44ff-a7a6-044cdd731cb4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:05.407291 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8de094b1-105a-44ff-a7a6-044cdd731cb4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:05.413170 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8de094b1-105a-44ff-a7a6-044cdd731cb4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:05.413615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8de094b1-105a-44ff-a7a6-044cdd731cb4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:05.414400 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8de094b1-105a-44ff-a7a6-044cdd731cb4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:05.415464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8de094b1-105a-44ff-a7a6-044cdd731cb4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:05.536501 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8de094b1-105a-44ff-a7a6-044cdd731cb4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:05.545415 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8de094b1-105a-44ff-a7a6-044cdd731cb4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:05.546928 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8de094b1-105a-44ff-a7a6-044cdd731cb4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:05.548056 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8de094b1-105a-44ff-a7a6-044cdd731cb4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.145123 Aug 30 07:55:05.548611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 563/1073] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:05 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:06.115435 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-538e5d29-2ae1-4ed0-8299-65b5cbc982b2 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:06.116077 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-538e5d29-2ae1-4ed0-8299-65b5cbc982b2 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:06.122591 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-538e5d29-2ae1-4ed0-8299-65b5cbc982b2 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:06.123040 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-538e5d29-2ae1-4ed0-8299-65b5cbc982b2 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:06.123788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-538e5d29-2ae1-4ed0-8299-65b5cbc982b2 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:06.124217 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-538e5d29-2ae1-4ed0-8299-65b5cbc982b2 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:06.242235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-50cd2a4d-4deb-4804-ae14-f77f72956da0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:06.243616 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-50cd2a4d-4deb-4804-ae14-f77f72956da0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:06.245398 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-538e5d29-2ae1-4ed0-8299-65b5cbc982b2 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:06.249475 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50cd2a4d-4deb-4804-ae14-f77f72956da0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:06.249912 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50cd2a4d-4deb-4804-ae14-f77f72956da0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:06.250907 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50cd2a4d-4deb-4804-ae14-f77f72956da0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:06.251331 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50cd2a4d-4deb-4804-ae14-f77f72956da0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:06.253479 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-538e5d29-2ae1-4ed0-8299-65b5cbc982b2 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.141627 Aug 30 07:55:06.254553 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 511/1074] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:06 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:06.385717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-50cd2a4d-4deb-4804-ae14-f77f72956da0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:06.392960 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-50cd2a4d-4deb-4804-ae14-f77f72956da0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.154453 Aug 30 07:55:06.393518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 564/1075] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:06 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:06.566663 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4b5d8ef3-da42-426a-ad90-ee8ee7af7725 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:06.567265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4b5d8ef3-da42-426a-ad90-ee8ee7af7725 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:06.574039 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4b5d8ef3-da42-426a-ad90-ee8ee7af7725 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:06.574521 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4b5d8ef3-da42-426a-ad90-ee8ee7af7725 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:06.575299 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4b5d8ef3-da42-426a-ad90-ee8ee7af7725 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:06.575732 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4b5d8ef3-da42-426a-ad90-ee8ee7af7725 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:06.702850 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4b5d8ef3-da42-426a-ad90-ee8ee7af7725 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:06.711196 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4b5d8ef3-da42-426a-ad90-ee8ee7af7725 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:06.713120 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4b5d8ef3-da42-426a-ad90-ee8ee7af7725 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:06.714291 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4b5d8ef3-da42-426a-ad90-ee8ee7af7725 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.151378 Aug 30 07:55:06.714847 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 512/1076] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:06 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:07.271172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d51ea177-8bea-40f8-b355-d94d0bc07225 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:07.271695 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d51ea177-8bea-40f8-b355-d94d0bc07225 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:07.279178 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d51ea177-8bea-40f8-b355-d94d0bc07225 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:07.279622 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d51ea177-8bea-40f8-b355-d94d0bc07225 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:07.280389 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d51ea177-8bea-40f8-b355-d94d0bc07225 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:07.280819 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d51ea177-8bea-40f8-b355-d94d0bc07225 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:07.403950 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d51ea177-8bea-40f8-b355-d94d0bc07225 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:07.411361 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1bf26f11-a35e-4dd6-8f7f-191adf1859ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:07.411883 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d51ea177-8bea-40f8-b355-d94d0bc07225 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.144833 Aug 30 07:55:07.412005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1bf26f11-a35e-4dd6-8f7f-191adf1859ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:07.412377 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 565/1077] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:07 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:07.418355 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bf26f11-a35e-4dd6-8f7f-191adf1859ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:07.418808 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bf26f11-a35e-4dd6-8f7f-191adf1859ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:07.419580 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bf26f11-a35e-4dd6-8f7f-191adf1859ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:07.420013 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1bf26f11-a35e-4dd6-8f7f-191adf1859ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:07.543008 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1bf26f11-a35e-4dd6-8f7f-191adf1859ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:07.550140 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1bf26f11-a35e-4dd6-8f7f-191adf1859ff tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.142466 Aug 30 07:55:07.550747 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 513/1078] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:07 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:55:07.733009 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5bcaa192-9d5b-488a-b9c4-4d3c8f88dd65 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:07.733612 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5bcaa192-9d5b-488a-b9c4-4d3c8f88dd65 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:07.739703 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5bcaa192-9d5b-488a-b9c4-4d3c8f88dd65 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:07.740141 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5bcaa192-9d5b-488a-b9c4-4d3c8f88dd65 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:07.740890 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5bcaa192-9d5b-488a-b9c4-4d3c8f88dd65 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:07.741312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5bcaa192-9d5b-488a-b9c4-4d3c8f88dd65 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:07.869643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5bcaa192-9d5b-488a-b9c4-4d3c8f88dd65 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:07.877929 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5bcaa192-9d5b-488a-b9c4-4d3c8f88dd65 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:07.879460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5bcaa192-9d5b-488a-b9c4-4d3c8f88dd65 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:07.880592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5bcaa192-9d5b-488a-b9c4-4d3c8f88dd65 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.151315 Aug 30 07:55:07.881161 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 566/1079] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:07 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:08.280729 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-12efcc72-e2dc-4d94-8b28-90cbd9f7e81a req-2457e813-6334-4fce-a40b-f381b0097be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35", "name": "network-vif-plugged", "status": "completed", "tag": "17a5b7fe-6ea4-4a61-995f-35648fa60831"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:55:08.282347 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:55:08.282347 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:55:08.293393 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-12efcc72-e2dc-4d94-8b28-90cbd9f7e81a req-2457e813-6334-4fce-a40b-f381b0097be7 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:08.294759 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-12efcc72-e2dc-4d94-8b28-90cbd9f7e81a req-2457e813-6334-4fce-a40b-f381b0097be7 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:08.312271 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-12efcc72-e2dc-4d94-8b28-90cbd9f7e81a req-2457e813-6334-4fce-a40b-f381b0097be7 service nova] Creating event network-vif-plugged:17a5b7fe-6ea4-4a61-995f-35648fa60831 for instance c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 on hv-cinder-80619 Aug 30 07:55:08.318205 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-12efcc72-e2dc-4d94-8b28-90cbd9f7e81a req-2457e813-6334-4fce-a40b-f381b0097be7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041036 Aug 30 07:55:08.318814 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 514/1080] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:55:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:55:08.431566 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0ab555d8-e005-45b0-975c-a7c27061b61a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:08.432099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0ab555d8-e005-45b0-975c-a7c27061b61a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:08.437983 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0ab555d8-e005-45b0-975c-a7c27061b61a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:08.438453 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0ab555d8-e005-45b0-975c-a7c27061b61a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:08.439220 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0ab555d8-e005-45b0-975c-a7c27061b61a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:08.439648 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0ab555d8-e005-45b0-975c-a7c27061b61a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:08.560591 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0ab555d8-e005-45b0-975c-a7c27061b61a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:08.567116 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b22dc9a1-e602-43ae-844c-3996a2fc87de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:08.567928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b22dc9a1-e602-43ae-844c-3996a2fc87de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:08.568058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0ab555d8-e005-45b0-975c-a7c27061b61a tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.141714 Aug 30 07:55:08.568450 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 567/1081] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:08 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:55:08.574502 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b22dc9a1-e602-43ae-844c-3996a2fc87de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:08.574950 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b22dc9a1-e602-43ae-844c-3996a2fc87de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:08.575897 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b22dc9a1-e602-43ae-844c-3996a2fc87de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:08.576339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b22dc9a1-e602-43ae-844c-3996a2fc87de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:08.697527 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b22dc9a1-e602-43ae-844c-3996a2fc87de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:08.704803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b22dc9a1-e602-43ae-844c-3996a2fc87de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.141654 Aug 30 07:55:08.705369 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 515/1082] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:08 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:55:08.899418 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-72aac9d9-7415-4d41-8ac2-e97a3185078e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:08.900047 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-72aac9d9-7415-4d41-8ac2-e97a3185078e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:08.905854 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72aac9d9-7415-4d41-8ac2-e97a3185078e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:08.906337 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72aac9d9-7415-4d41-8ac2-e97a3185078e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:08.907100 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72aac9d9-7415-4d41-8ac2-e97a3185078e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:08.907534 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-72aac9d9-7415-4d41-8ac2-e97a3185078e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:09.027765 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-72aac9d9-7415-4d41-8ac2-e97a3185078e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:09.035909 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-72aac9d9-7415-4d41-8ac2-e97a3185078e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:09.037396 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-72aac9d9-7415-4d41-8ac2-e97a3185078e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:09.038556 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-72aac9d9-7415-4d41-8ac2-e97a3185078e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.142917 Aug 30 07:55:09.039119 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 568/1083] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:08 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:09.585026 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-042149ac-8630-4639-94f1-6bf84f0621fe tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:09.585633 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-042149ac-8630-4639-94f1-6bf84f0621fe tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:09.592131 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-042149ac-8630-4639-94f1-6bf84f0621fe tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:09.592568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-042149ac-8630-4639-94f1-6bf84f0621fe tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:09.593316 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-042149ac-8630-4639-94f1-6bf84f0621fe tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:09.593749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-042149ac-8630-4639-94f1-6bf84f0621fe tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:09.717322 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-042149ac-8630-4639-94f1-6bf84f0621fe tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:09.721692 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d3b82b98-6bb6-4669-88cc-a6df32246208 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:09.722379 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d3b82b98-6bb6-4669-88cc-a6df32246208 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:09.725033 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-042149ac-8630-4639-94f1-6bf84f0621fe tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1358 microversion: 2.1 time: 0.143617 Aug 30 07:55:09.725592 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 516/1084] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:09 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:55:09.728673 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d3b82b98-6bb6-4669-88cc-a6df32246208 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:09.729125 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d3b82b98-6bb6-4669-88cc-a6df32246208 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:09.729894 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d3b82b98-6bb6-4669-88cc-a6df32246208 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:09.730357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d3b82b98-6bb6-4669-88cc-a6df32246208 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:09.853974 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d3b82b98-6bb6-4669-88cc-a6df32246208 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:09.861580 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d3b82b98-6bb6-4669-88cc-a6df32246208 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.143536 Aug 30 07:55:09.862135 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 569/1085] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:09 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:55:10.057965 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ceef2b1c-83f7-4605-84ed-bcbb96f9ef18 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:10.058604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ceef2b1c-83f7-4605-84ed-bcbb96f9ef18 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:10.064600 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ceef2b1c-83f7-4605-84ed-bcbb96f9ef18 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:10.065076 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ceef2b1c-83f7-4605-84ed-bcbb96f9ef18 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:10.065830 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ceef2b1c-83f7-4605-84ed-bcbb96f9ef18 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:10.066294 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ceef2b1c-83f7-4605-84ed-bcbb96f9ef18 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:10.185552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ceef2b1c-83f7-4605-84ed-bcbb96f9ef18 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:10.193606 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ceef2b1c-83f7-4605-84ed-bcbb96f9ef18 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:10.195113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ceef2b1c-83f7-4605-84ed-bcbb96f9ef18 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:10.196330 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ceef2b1c-83f7-4605-84ed-bcbb96f9ef18 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.142800 Aug 30 07:55:10.196886 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 517/1086] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:10 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:55:10.742008 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a274d918-44a2-4368-8762-f0fb8b27d9cb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:10.742692 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a274d918-44a2-4368-8762-f0fb8b27d9cb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:10.748480 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a274d918-44a2-4368-8762-f0fb8b27d9cb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:10.748929 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a274d918-44a2-4368-8762-f0fb8b27d9cb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:10.749684 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a274d918-44a2-4368-8762-f0fb8b27d9cb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:10.750113 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a274d918-44a2-4368-8762-f0fb8b27d9cb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:10.869354 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a274d918-44a2-4368-8762-f0fb8b27d9cb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:10.876803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a274d918-44a2-4368-8762-f0fb8b27d9cb tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1549 microversion: 2.1 time: 0.138523 Aug 30 07:55:10.877361 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 570/1087] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:10 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1549 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:10.878549 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a72eb930-4a07-44bb-a5b3-5fa86acd81a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:10.879156 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a72eb930-4a07-44bb-a5b3-5fa86acd81a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:10.885192 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a72eb930-4a07-44bb-a5b3-5fa86acd81a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:10.885719 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a72eb930-4a07-44bb-a5b3-5fa86acd81a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:10.886583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a72eb930-4a07-44bb-a5b3-5fa86acd81a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:10.887083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a72eb930-4a07-44bb-a5b3-5fa86acd81a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:10.892512 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1bfa7970-4e58-4050-a821-738d9aa76f0c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:10.893129 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1bfa7970-4e58-4050-a821-738d9aa76f0c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:10.898905 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bfa7970-4e58-4050-a821-738d9aa76f0c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:10.899363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bfa7970-4e58-4050-a821-738d9aa76f0c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:10.900166 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bfa7970-4e58-4050-a821-738d9aa76f0c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:10.900604 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1bfa7970-4e58-4050-a821-738d9aa76f0c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:11.012933 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a72eb930-4a07-44bb-a5b3-5fa86acd81a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:11.020881 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a72eb930-4a07-44bb-a5b3-5fa86acd81a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.145878 Aug 30 07:55:11.021467 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 518/1088] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:10 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:55:11.027280 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1bfa7970-4e58-4050-a821-738d9aa76f0c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:11.035076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1bfa7970-4e58-4050-a821-738d9aa76f0c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1549 microversion: 2.1 time: 0.146034 Aug 30 07:55:11.035657 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 571/1089] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:10 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:55:11.051318 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3b050466-2e0c-4bc8-b32c-602c52e4f0f1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:11.054659 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:55:11.054659 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:55:11.056233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3b050466-2e0c-4bc8-b32c-602c52e4f0f1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:11.056978 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3b050466-2e0c-4bc8-b32c-602c52e4f0f1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Searching by: {'deleted': False, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf'} {{(pid=114670) get_all /opt/stack/nova/nova/compute/api.py:2868}} Aug 30 07:55:11.064501 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3b050466-2e0c-4bc8-b32c-602c52e4f0f1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:11.064941 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3b050466-2e0c-4bc8-b32c-602c52e4f0f1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:11.065733 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3b050466-2e0c-4bc8-b32c-602c52e4f0f1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:11.066192 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3b050466-2e0c-4bc8-b32c-602c52e4f0f1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:11.158250 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.multi_cell_list [None req-3b050466-2e0c-4bc8-b32c-602c52e4f0f1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=114670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 30 07:55:11.214775 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a31bd338-ab67-4022-9281-6aee31d7775b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:11.215381 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a31bd338-ab67-4022-9281-6aee31d7775b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:11.221208 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a31bd338-ab67-4022-9281-6aee31d7775b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:11.221643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a31bd338-ab67-4022-9281-6aee31d7775b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:11.222445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a31bd338-ab67-4022-9281-6aee31d7775b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:11.222870 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a31bd338-ab67-4022-9281-6aee31d7775b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:11.254840 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3b050466-2e0c-4bc8-b32c-602c52e4f0f1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207014 Aug 30 07:55:11.255427 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 519/1090] 10.222.0.73 () {58 vars in 1125 bytes} [Mon Aug 30 07:55:11 2021] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:55:11.265329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1db8122f-3053-4f8e-8b61-b717d7767419 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:11.265862 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1db8122f-3053-4f8e-8b61-b717d7767419 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:11.271954 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1db8122f-3053-4f8e-8b61-b717d7767419 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:11.272409 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1db8122f-3053-4f8e-8b61-b717d7767419 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:11.273184 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1db8122f-3053-4f8e-8b61-b717d7767419 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:11.274359 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1db8122f-3053-4f8e-8b61-b717d7767419 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:11.348836 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a31bd338-ab67-4022-9281-6aee31d7775b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:11.358605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a31bd338-ab67-4022-9281-6aee31d7775b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:11.360331 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a31bd338-ab67-4022-9281-6aee31d7775b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:11.361779 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a31bd338-ab67-4022-9281-6aee31d7775b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.151393 Aug 30 07:55:11.362578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 572/1091] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:11 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:55:11.397638 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1db8122f-3053-4f8e-8b61-b717d7767419 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:11.407199 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1db8122f-3053-4f8e-8b61-b717d7767419 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1549 microversion: 2.1 time: 0.145416 Aug 30 07:55:11.407770 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 520/1092] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:11 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1549 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:55:12.041550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d38c5434-be8b-4c15-9181-bf24ef460772 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:12.042182 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d38c5434-be8b-4c15-9181-bf24ef460772 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:12.047985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d38c5434-be8b-4c15-9181-bf24ef460772 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:12.048429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d38c5434-be8b-4c15-9181-bf24ef460772 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:12.049184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d38c5434-be8b-4c15-9181-bf24ef460772 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:12.049614 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d38c5434-be8b-4c15-9181-bf24ef460772 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:12.173357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d38c5434-be8b-4c15-9181-bf24ef460772 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:12.182223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d38c5434-be8b-4c15-9181-bf24ef460772 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.144192 Aug 30 07:55:12.183130 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 573/1093] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:12 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:12.381500 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c4304649-7ad5-466f-bc2c-3a2b99de0a42 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:12.382692 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c4304649-7ad5-466f-bc2c-3a2b99de0a42 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:12.389977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4304649-7ad5-466f-bc2c-3a2b99de0a42 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:12.390458 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4304649-7ad5-466f-bc2c-3a2b99de0a42 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:12.391229 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4304649-7ad5-466f-bc2c-3a2b99de0a42 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:12.391794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4304649-7ad5-466f-bc2c-3a2b99de0a42 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:12.511668 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c4304649-7ad5-466f-bc2c-3a2b99de0a42 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:12.519602 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c4304649-7ad5-466f-bc2c-3a2b99de0a42 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:12.521074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c4304649-7ad5-466f-bc2c-3a2b99de0a42 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:12.522219 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c4304649-7ad5-466f-bc2c-3a2b99de0a42 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.144888 Aug 30 07:55:12.522772 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 521/1094] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:12 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:12.928721 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d771899e-a5f4-4aa4-8c11-85e54d4a53bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee6f77df-f87b-400d-a298-32c6b7ff555d"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:55:12.930377 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d771899e-a5f4-4aa4-8c11-85e54d4a53bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:12.936208 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d771899e-a5f4-4aa4-8c11-85e54d4a53bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:12.936622 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d771899e-a5f4-4aa4-8c11-85e54d4a53bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:12.937413 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d771899e-a5f4-4aa4-8c11-85e54d4a53bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:12.937844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d771899e-a5f4-4aa4-8c11-85e54d4a53bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:13.169719 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d771899e-a5f4-4aa4-8c11-85e54d4a53bd tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "POST /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244418 Aug 30 07:55:13.170578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 574/1095] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:55:12 2021] POST /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:55:13.199182 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6bf1d42a-ef4d-43a8-a02c-372ee07cdc25 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:13.199802 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6bf1d42a-ef4d-43a8-a02c-372ee07cdc25 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:13.209847 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bf1d42a-ef4d-43a8-a02c-372ee07cdc25 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:13.210259 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bf1d42a-ef4d-43a8-a02c-372ee07cdc25 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:13.211327 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bf1d42a-ef4d-43a8-a02c-372ee07cdc25 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:13.211798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bf1d42a-ef4d-43a8-a02c-372ee07cdc25 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:13.339759 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6bf1d42a-ef4d-43a8-a02c-372ee07cdc25 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:13.347153 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6bf1d42a-ef4d-43a8-a02c-372ee07cdc25 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.151757 Aug 30 07:55:13.347734 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 522/1096] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:13 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:13.541559 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d2ed9d65-2335-4e1e-9966-3d63e7e0a6f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:13.542301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d2ed9d65-2335-4e1e-9966-3d63e7e0a6f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:13.548237 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d2ed9d65-2335-4e1e-9966-3d63e7e0a6f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:13.548632 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d2ed9d65-2335-4e1e-9966-3d63e7e0a6f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:13.549395 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d2ed9d65-2335-4e1e-9966-3d63e7e0a6f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:13.549835 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d2ed9d65-2335-4e1e-9966-3d63e7e0a6f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:13.672757 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d2ed9d65-2335-4e1e-9966-3d63e7e0a6f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:13.681220 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d2ed9d65-2335-4e1e-9966-3d63e7e0a6f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:13.682776 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d2ed9d65-2335-4e1e-9966-3d63e7e0a6f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:13.683924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d2ed9d65-2335-4e1e-9966-3d63e7e0a6f6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.147151 Aug 30 07:55:13.684490 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 575/1097] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:13 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:14.321440 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-61e6beb3-b5ee-4aa3-b320-fc8fc812849b req-daa41105-8f0a-42b4-8ca1-046dd5fabcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f", "name": "network-vif-plugged", "status": "completed", "tag": "32f744e1-43b5-4cbe-a3b6-9ee81f793879"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:55:14.322930 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:55:14.322930 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:55:14.330295 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-61e6beb3-b5ee-4aa3-b320-fc8fc812849b req-daa41105-8f0a-42b4-8ca1-046dd5fabcb3 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:14.330529 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-61e6beb3-b5ee-4aa3-b320-fc8fc812849b req-daa41105-8f0a-42b4-8ca1-046dd5fabcb3 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:14.341664 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-61e6beb3-b5ee-4aa3-b320-fc8fc812849b req-daa41105-8f0a-42b4-8ca1-046dd5fabcb3 service nova] Creating event network-vif-plugged:32f744e1-43b5-4cbe-a3b6-9ee81f793879 for instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f on hv-cinder-80619 Aug 30 07:55:14.347134 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-61e6beb3-b5ee-4aa3-b320-fc8fc812849b req-daa41105-8f0a-42b4-8ca1-046dd5fabcb3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030099 Aug 30 07:55:14.348077 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 523/1098] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:55:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:55:14.367389 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-57914800-42c2-4315-b275-cef17832ab8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:14.367389 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-57914800-42c2-4315-b275-cef17832ab8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:14.373531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-57914800-42c2-4315-b275-cef17832ab8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:14.374129 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-57914800-42c2-4315-b275-cef17832ab8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:14.375054 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-57914800-42c2-4315-b275-cef17832ab8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:14.375594 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-57914800-42c2-4315-b275-cef17832ab8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:14.500920 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-57914800-42c2-4315-b275-cef17832ab8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:14.509012 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-57914800-42c2-4315-b275-cef17832ab8e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.147882 Aug 30 07:55:14.509583 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 576/1099] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:14 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:14.702408 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2d194656-f28d-4862-9254-b654d7dfc412 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:14.703103 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2d194656-f28d-4862-9254-b654d7dfc412 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:14.709190 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d194656-f28d-4862-9254-b654d7dfc412 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:14.709635 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d194656-f28d-4862-9254-b654d7dfc412 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:14.710429 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d194656-f28d-4862-9254-b654d7dfc412 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:14.711175 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2d194656-f28d-4862-9254-b654d7dfc412 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:14.871810 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2d194656-f28d-4862-9254-b654d7dfc412 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:14.880150 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2d194656-f28d-4862-9254-b654d7dfc412 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:14.881616 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2d194656-f28d-4862-9254-b654d7dfc412 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:14.882781 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2d194656-f28d-4862-9254-b654d7dfc412 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.184420 Aug 30 07:55:14.883536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 524/1100] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:14 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:15.526607 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-61e9bd3f-b2be-4d25-93d3-06b24ade0b9c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:15.527216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-61e9bd3f-b2be-4d25-93d3-06b24ade0b9c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:15.533095 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-61e9bd3f-b2be-4d25-93d3-06b24ade0b9c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:15.533543 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-61e9bd3f-b2be-4d25-93d3-06b24ade0b9c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:15.534334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-61e9bd3f-b2be-4d25-93d3-06b24ade0b9c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:15.534770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-61e9bd3f-b2be-4d25-93d3-06b24ade0b9c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:15.654852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-61e9bd3f-b2be-4d25-93d3-06b24ade0b9c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:15.662035 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-61e9bd3f-b2be-4d25-93d3-06b24ade0b9c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.139845 Aug 30 07:55:15.662644 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 577/1101] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:15 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:15.905055 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3919eb05-f394-427b-a213-178a995a51ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:15.905569 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3919eb05-f394-427b-a213-178a995a51ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:15.911338 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3919eb05-f394-427b-a213-178a995a51ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:15.911780 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3919eb05-f394-427b-a213-178a995a51ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:15.912532 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3919eb05-f394-427b-a213-178a995a51ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:15.912961 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3919eb05-f394-427b-a213-178a995a51ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:16.032046 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3919eb05-f394-427b-a213-178a995a51ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:16.040336 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3919eb05-f394-427b-a213-178a995a51ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:16.041811 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3919eb05-f394-427b-a213-178a995a51ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:16.042955 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3919eb05-f394-427b-a213-178a995a51ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1807 microversion: 2.20 time: 0.141649 Aug 30 07:55:16.043515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 525/1102] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:15 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:16.678977 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d29c788a-e31e-4649-a16b-655a56e0da12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:16.680283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d29c788a-e31e-4649-a16b-655a56e0da12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:16.686504 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d29c788a-e31e-4649-a16b-655a56e0da12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:16.687031 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d29c788a-e31e-4649-a16b-655a56e0da12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:16.687903 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d29c788a-e31e-4649-a16b-655a56e0da12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:16.688368 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d29c788a-e31e-4649-a16b-655a56e0da12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:16.813601 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d29c788a-e31e-4649-a16b-655a56e0da12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:16.822628 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d29c788a-e31e-4649-a16b-655a56e0da12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.147283 Aug 30 07:55:16.823215 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 578/1103] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:16 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:17.061228 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4a90f0b3-0e4c-4ee2-9099-ffc4194f7e13 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:17.061832 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4a90f0b3-0e4c-4ee2-9099-ffc4194f7e13 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:17.067653 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4a90f0b3-0e4c-4ee2-9099-ffc4194f7e13 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:17.068162 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4a90f0b3-0e4c-4ee2-9099-ffc4194f7e13 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:17.069259 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4a90f0b3-0e4c-4ee2-9099-ffc4194f7e13 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:17.069688 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4a90f0b3-0e4c-4ee2-9099-ffc4194f7e13 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:17.193649 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4a90f0b3-0e4c-4ee2-9099-ffc4194f7e13 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:17.202052 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4a90f0b3-0e4c-4ee2-9099-ffc4194f7e13 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:17.203574 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4a90f0b3-0e4c-4ee2-9099-ffc4194f7e13 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:17.204736 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4a90f0b3-0e4c-4ee2-9099-ffc4194f7e13 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1794 microversion: 2.20 time: 0.147239 Aug 30 07:55:17.205329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 526/1104] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:55:17 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1794 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:55:17.839429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-138a059f-517c-4523-8039-8c6919d052bc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:17.840055 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-138a059f-517c-4523-8039-8c6919d052bc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:17.845986 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-138a059f-517c-4523-8039-8c6919d052bc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:17.846456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-138a059f-517c-4523-8039-8c6919d052bc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:17.847216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-138a059f-517c-4523-8039-8c6919d052bc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:17.847645 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-138a059f-517c-4523-8039-8c6919d052bc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:17.969993 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-138a059f-517c-4523-8039-8c6919d052bc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:17.977773 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-138a059f-517c-4523-8039-8c6919d052bc tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.142652 Aug 30 07:55:17.978368 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 579/1105] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:17 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:18.995194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fee34595-6e52-491d-a5e2-f48736539099 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:18.995809 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fee34595-6e52-491d-a5e2-f48736539099 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:19.001640 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fee34595-6e52-491d-a5e2-f48736539099 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:19.002091 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fee34595-6e52-491d-a5e2-f48736539099 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:19.002881 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fee34595-6e52-491d-a5e2-f48736539099 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:19.003314 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fee34595-6e52-491d-a5e2-f48736539099 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:19.122363 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-fee34595-6e52-491d-a5e2-f48736539099 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:19.129543 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fee34595-6e52-491d-a5e2-f48736539099 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.138145 Aug 30 07:55:19.130104 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 527/1106] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:18 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:55:20.147097 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7853f5db-d989-45f7-85ed-78b9957518d2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:20.148300 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7853f5db-d989-45f7-85ed-78b9957518d2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:20.154339 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7853f5db-d989-45f7-85ed-78b9957518d2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:20.154782 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7853f5db-d989-45f7-85ed-78b9957518d2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:20.155542 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7853f5db-d989-45f7-85ed-78b9957518d2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:20.155974 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7853f5db-d989-45f7-85ed-78b9957518d2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:20.275892 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7853f5db-d989-45f7-85ed-78b9957518d2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:20.283235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7853f5db-d989-45f7-85ed-78b9957518d2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1674 microversion: 2.1 time: 0.139786 Aug 30 07:55:20.283806 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 580/1107] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:20 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1674 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:20.751122 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7a5034a4-386f-4afc-9edc-e39a073ceecc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:20.751762 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7a5034a4-386f-4afc-9edc-e39a073ceecc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:20.757753 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7a5034a4-386f-4afc-9edc-e39a073ceecc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:20.758241 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7a5034a4-386f-4afc-9edc-e39a073ceecc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:20.759028 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7a5034a4-386f-4afc-9edc-e39a073ceecc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:20.759455 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7a5034a4-386f-4afc-9edc-e39a073ceecc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:20.878931 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7a5034a4-386f-4afc-9edc-e39a073ceecc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:20.886494 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7a5034a4-386f-4afc-9edc-e39a073ceecc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1595 microversion: 2.1 time: 0.139032 Aug 30 07:55:20.887057 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 528/1108] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:20 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1595 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:21.300798 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9de3803b-7964-4e93-b544-618bb5e5d555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:21.301445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9de3803b-7964-4e93-b544-618bb5e5d555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:21.309025 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9de3803b-7964-4e93-b544-618bb5e5d555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:21.309474 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9de3803b-7964-4e93-b544-618bb5e5d555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:21.310286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9de3803b-7964-4e93-b544-618bb5e5d555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:21.310724 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9de3803b-7964-4e93-b544-618bb5e5d555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:21.442020 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9de3803b-7964-4e93-b544-618bb5e5d555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:21.449878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9de3803b-7964-4e93-b544-618bb5e5d555 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1651 microversion: 2.1 time: 0.152796 Aug 30 07:55:21.450491 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 581/1109] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:21 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1651 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:21.466473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3ca62740-148d-4363-9da6-efe54927a1c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:55:21.472509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3ca62740-148d-4363-9da6-efe54927a1c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:21.472987 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3ca62740-148d-4363-9da6-efe54927a1c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:21.497664 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3ca62740-148d-4363-9da6-efe54927a1c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Going to try to start instance {{(pid=114670) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 30 07:55:21.542874 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3ca62740-148d-4363-9da6-efe54927a1c5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action" status: 202 len: 0 microversion: 2.1 time: 0.079702 Aug 30 07:55:21.543696 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 529/1110] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:55:21 2021] POST /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:55:21.552966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e31c0a50-1087-4a82-9575-326cb4d469ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:21.553859 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e31c0a50-1087-4a82-9575-326cb4d469ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:21.561499 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e31c0a50-1087-4a82-9575-326cb4d469ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:21.562197 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e31c0a50-1087-4a82-9575-326cb4d469ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:21.563107 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e31c0a50-1087-4a82-9575-326cb4d469ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:21.563580 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e31c0a50-1087-4a82-9575-326cb4d469ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:21.702484 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e31c0a50-1087-4a82-9575-326cb4d469ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:21.709654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e31c0a50-1087-4a82-9575-326cb4d469ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1660 microversion: 2.1 time: 0.160947 Aug 30 07:55:21.710774 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 582/1111] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:21 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1660 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:22.728624 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-92ee3d6f-8bc2-49a6-a06b-9c63ab2a139e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:22.729460 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-92ee3d6f-8bc2-49a6-a06b-9c63ab2a139e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:22.735733 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92ee3d6f-8bc2-49a6-a06b-9c63ab2a139e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:22.736179 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92ee3d6f-8bc2-49a6-a06b-9c63ab2a139e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:22.736943 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92ee3d6f-8bc2-49a6-a06b-9c63ab2a139e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:22.737418 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92ee3d6f-8bc2-49a6-a06b-9c63ab2a139e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:22.930863 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-92ee3d6f-8bc2-49a6-a06b-9c63ab2a139e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:22.938172 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-92ee3d6f-8bc2-49a6-a06b-9c63ab2a139e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1660 microversion: 2.1 time: 0.214507 Aug 30 07:55:22.938743 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 530/1112] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:22 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1660 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:23.659157 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-fbd9a170-9e6b-4661-8988-a5c60d2b2015 req-b885e092-5956-40ba-8c98-710828ddebba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35", "tag": "17a5b7fe-6ea4-4a61-995f-35648fa60831"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:55:23.660707 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:55:23.660707 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:55:23.668670 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-fbd9a170-9e6b-4661-8988-a5c60d2b2015 req-b885e092-5956-40ba-8c98-710828ddebba service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:23.669114 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-fbd9a170-9e6b-4661-8988-a5c60d2b2015 req-b885e092-5956-40ba-8c98-710828ddebba service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:23.681016 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-fbd9a170-9e6b-4661-8988-a5c60d2b2015 req-b885e092-5956-40ba-8c98-710828ddebba service nova] Creating event network-changed:17a5b7fe-6ea4-4a61-995f-35648fa60831 for instance c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 on hv-cinder-80619 Aug 30 07:55:23.687146 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-fbd9a170-9e6b-4661-8988-a5c60d2b2015 req-b885e092-5956-40ba-8c98-710828ddebba service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031020 Aug 30 07:55:23.687619 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 583/1113] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:55:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:55:23.956592 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fdc145b0-d65a-4a6b-8a1f-a7c6824596c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:23.957445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fdc145b0-d65a-4a6b-8a1f-a7c6824596c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:23.969056 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fdc145b0-d65a-4a6b-8a1f-a7c6824596c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:23.969526 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fdc145b0-d65a-4a6b-8a1f-a7c6824596c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:23.970357 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fdc145b0-d65a-4a6b-8a1f-a7c6824596c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:23.971233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fdc145b0-d65a-4a6b-8a1f-a7c6824596c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:24.204512 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-fdc145b0-d65a-4a6b-8a1f-a7c6824596c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:24.216472 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fdc145b0-d65a-4a6b-8a1f-a7c6824596c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1664 microversion: 2.1 time: 0.263370 Aug 30 07:55:24.225504 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 531/1114] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:23 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1664 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:55:24.777788 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d744190b-25ff-4186-b296-91d2941e08e3 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1355206187"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:55:24.778667 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d744190b-25ff-4186-b296-91d2941e08e3 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:24.785246 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d744190b-25ff-4186-b296-91d2941e08e3 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:24.785698 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d744190b-25ff-4186-b296-91d2941e08e3 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:24.786500 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d744190b-25ff-4186-b296-91d2941e08e3 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:24.786968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d744190b-25ff-4186-b296-91d2941e08e3 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:24.915672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.network.security_group_api [None req-d744190b-25ff-4186-b296-91d2941e08e3 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Adding security group 41342c03-de87-44e0-b0f0-9cb0deee3e59 to port 17a5b7fe-6ea4-4a61-995f-35648fa60831 Aug 30 07:55:25.265801 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d744190b-25ff-4186-b296-91d2941e08e3 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "POST /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/action" status: 202 len: 0 microversion: 2.1 time: 0.492112 Aug 30 07:55:25.266792 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 584/1115] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:55:24 2021] POST /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:55:25.282046 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3d73ed2b-ba01-4265-872f-343cfb574717 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:55:25.284668 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3d73ed2b-ba01-4265-872f-343cfb574717 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:55:25.296774 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3d73ed2b-ba01-4265-872f-343cfb574717 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:25.297507 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3d73ed2b-ba01-4265-872f-343cfb574717 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:25.298710 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3d73ed2b-ba01-4265-872f-343cfb574717 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:25.299310 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3d73ed2b-ba01-4265-872f-343cfb574717 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:25.422056 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-202e7f1e-7971-4067-bb94-747dae0ec835 req-50c941e2-25e9-4cc9-9c3e-c225e2723fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35", "tag": "17a5b7fe-6ea4-4a61-995f-35648fa60831"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:55:25.423668 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:55:25.423668 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:55:25.432053 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-202e7f1e-7971-4067-bb94-747dae0ec835 req-50c941e2-25e9-4cc9-9c3e-c225e2723fc9 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:55:25.432705 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-202e7f1e-7971-4067-bb94-747dae0ec835 req-50c941e2-25e9-4cc9-9c3e-c225e2723fc9 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:55:25.444862 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-202e7f1e-7971-4067-bb94-747dae0ec835 req-50c941e2-25e9-4cc9-9c3e-c225e2723fc9 service nova] Creating event network-changed:17a5b7fe-6ea4-4a61-995f-35648fa60831 for instance c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 on hv-cinder-80619 Aug 30 07:55:25.453143 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3d73ed2b-ba01-4265-872f-343cfb574717 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:55:25.453711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-202e7f1e-7971-4067-bb94-747dae0ec835 req-50c941e2-25e9-4cc9-9c3e-c225e2723fc9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181434 Aug 30 07:55:25.454752 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 532/1116] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:55:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:55:25.464020 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3d73ed2b-ba01-4265-872f-343cfb574717 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1761 microversion: 2.1 time: 0.193107 Aug 30 07:55:25.464617 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 585/1117] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:55:25 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1761 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:12.801349 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 07:56:12.802073 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: Mon Aug 30 07:56:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 07:56:13.848262 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 07:56:13.848864 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: Mon Aug 30 07:56:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 07:56:24.149362 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [926fbc4d-903d-4d96-bec4-b35eb2ef22f6] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 07:56:24.154243 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9a6517f7-262e-4734-b066-072fcc2a6e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:24.154817 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9a6517f7-262e-4734-b066-072fcc2a6e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:24.160950 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9a6517f7-262e-4734-b066-072fcc2a6e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:24.161397 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9a6517f7-262e-4734-b066-072fcc2a6e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:24.162180 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9a6517f7-262e-4734-b066-072fcc2a6e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:24.162648 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9a6517f7-262e-4734-b066-072fcc2a6e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:24.190890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9a6517f7-262e-4734-b066-072fcc2a6e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-volume_attachments/d6c942c1-9696-4fed-8db6-80e6ee20ebb2" status: 200 len: 194 microversion: 2.20 time: 0.042888 Aug 30 07:56:24.191463 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 533/1118] 10.222.0.73 () {60 vars in 1454 bytes} [Mon Aug 30 07:56:24 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-volume_attachments/d6c942c1-9696-4fed-8db6-80e6ee20ebb2 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:56:24.256974 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4732551e-d5ab-48fe-b690-f547dc71b26c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:24.257501 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4732551e-d5ab-48fe-b690-f547dc71b26c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:24.264071 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4732551e-d5ab-48fe-b690-f547dc71b26c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:24.264528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4732551e-d5ab-48fe-b690-f547dc71b26c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:24.265320 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4732551e-d5ab-48fe-b690-f547dc71b26c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:24.265751 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4732551e-d5ab-48fe-b690-f547dc71b26c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:24.348351 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-4732551e-d5ab-48fe-b690-f547dc71b26c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lazy-loading 'services' on Instance uuid 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:56:24.451753 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4732551e-d5ab-48fe-b690-f547dc71b26c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-volume_attachments/d6c942c1-9696-4fed-8db6-80e6ee20ebb2" status: 202 len: 0 microversion: 2.20 time: 0.198547 Aug 30 07:56:24.452326 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 586/1119] 10.222.0.73 () {60 vars in 1457 bytes} [Mon Aug 30 07:56:24 2021] DELETE /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-volume_attachments/d6c942c1-9696-4fed-8db6-80e6ee20ebb2 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:56:24.461297 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-02accf85-6325-493a-88f9-7cf564d3d42c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:24.462248 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-02accf85-6325-493a-88f9-7cf564d3d42c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:24.468863 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-02accf85-6325-493a-88f9-7cf564d3d42c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:24.469384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-02accf85-6325-493a-88f9-7cf564d3d42c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:24.470477 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-02accf85-6325-493a-88f9-7cf564d3d42c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:24.471010 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-02accf85-6325-493a-88f9-7cf564d3d42c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:24.505128 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-02accf85-6325-493a-88f9-7cf564d3d42c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048416 Aug 30 07:56:24.505684 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 534/1120] 10.222.0.73 () {60 vars in 1343 bytes} [Mon Aug 30 07:56:24 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:56:25.518590 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-17e0af3e-7934-4c6d-a143-fdf8481f75d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:25.519647 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-17e0af3e-7934-4c6d-a143-fdf8481f75d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:25.526303 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17e0af3e-7934-4c6d-a143-fdf8481f75d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:25.526692 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17e0af3e-7934-4c6d-a143-fdf8481f75d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:25.527441 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17e0af3e-7934-4c6d-a143-fdf8481f75d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:25.527870 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17e0af3e-7934-4c6d-a143-fdf8481f75d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:25.556482 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-17e0af3e-7934-4c6d-a143-fdf8481f75d1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042061 Aug 30 07:56:25.557027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 587/1121] 10.222.0.73 () {60 vars in 1343 bytes} [Mon Aug 30 07:56:25 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:25.618502 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6576d225-5cfd-492f-b094-8bbcd7bf6248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:25.619039 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6576d225-5cfd-492f-b094-8bbcd7bf6248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:25.639316 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6576d225-5cfd-492f-b094-8bbcd7bf6248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:25.639761 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6576d225-5cfd-492f-b094-8bbcd7bf6248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:25.640523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6576d225-5cfd-492f-b094-8bbcd7bf6248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:25.640949 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6576d225-5cfd-492f-b094-8bbcd7bf6248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:25.644590 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] [926fbc4d-903d-4d96-bec4-b35eb2ef22f6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59596. Aug 30 07:56:25.667491 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6576d225-5cfd-492f-b094-8bbcd7bf6248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Going to try to terminate instance {{(pid=114670) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:56:25.740965 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6576d225-5cfd-492f-b094-8bbcd7bf6248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 204 len: 0 microversion: 2.20 time: 0.125681 Aug 30 07:56:25.741921 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 535/1122] 10.222.0.73 () {60 vars in 1280 bytes} [Mon Aug 30 07:56:25 2021] DELETE /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 07:56:25.750381 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-231ac9fc-c7dc-4084-8d70-76055e74b16c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:25.751061 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-231ac9fc-c7dc-4084-8d70-76055e74b16c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:25.757085 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-231ac9fc-c7dc-4084-8d70-76055e74b16c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:25.757533 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-231ac9fc-c7dc-4084-8d70-76055e74b16c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:25.758324 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-231ac9fc-c7dc-4084-8d70-76055e74b16c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:25.758751 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-231ac9fc-c7dc-4084-8d70-76055e74b16c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:25.882529 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-231ac9fc-c7dc-4084-8d70-76055e74b16c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:25.890950 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-231ac9fc-c7dc-4084-8d70-76055e74b16c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:25.892474 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-231ac9fc-c7dc-4084-8d70-76055e74b16c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:25.893637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-231ac9fc-c7dc-4084-8d70-76055e74b16c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.147126 Aug 30 07:56:25.894206 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 588/1123] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:25 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:56:26.913272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f4f6ddac-1554-453f-9cdd-703def7b6b14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:26.913967 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f4f6ddac-1554-453f-9cdd-703def7b6b14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:26.920509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f4f6ddac-1554-453f-9cdd-703def7b6b14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:26.920947 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f4f6ddac-1554-453f-9cdd-703def7b6b14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:26.921695 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f4f6ddac-1554-453f-9cdd-703def7b6b14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:26.922118 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f4f6ddac-1554-453f-9cdd-703def7b6b14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:27.052361 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f4f6ddac-1554-453f-9cdd-703def7b6b14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:27.060127 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f4f6ddac-1554-453f-9cdd-703def7b6b14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:27.061613 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f4f6ddac-1554-453f-9cdd-703def7b6b14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:27.062770 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f4f6ddac-1554-453f-9cdd-703def7b6b14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.153586 Aug 30 07:56:27.063316 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 536/1124] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:26 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:56:28.080977 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-21096c6c-1d66-409f-92a2-fc8fe29c3779 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:28.081633 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-21096c6c-1d66-409f-92a2-fc8fe29c3779 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:28.087528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21096c6c-1d66-409f-92a2-fc8fe29c3779 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:28.088042 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21096c6c-1d66-409f-92a2-fc8fe29c3779 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:28.088803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21096c6c-1d66-409f-92a2-fc8fe29c3779 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:28.089235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21096c6c-1d66-409f-92a2-fc8fe29c3779 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:28.215493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-21096c6c-1d66-409f-92a2-fc8fe29c3779 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:28.223252 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-21096c6c-1d66-409f-92a2-fc8fe29c3779 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:28.224737 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-21096c6c-1d66-409f-92a2-fc8fe29c3779 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:28.225861 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-21096c6c-1d66-409f-92a2-fc8fe29c3779 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1722 microversion: 2.20 time: 0.148617 Aug 30 07:56:28.226445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 589/1125] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:28 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:56:28.749521 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-4b34b456-88ee-410c-908e-88b7a4b458b6 req-9592d99d-0ec2-4cd6-9cbd-daf0600d22dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f", "name": "network-vif-deleted", "tag": "32f744e1-43b5-4cbe-a3b6-9ee81f793879"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:28.751313 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:56:28.751313 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:56:28.760546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-4b34b456-88ee-410c-908e-88b7a4b458b6 req-9592d99d-0ec2-4cd6-9cbd-daf0600d22dc service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:28.761479 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-4b34b456-88ee-410c-908e-88b7a4b458b6 req-9592d99d-0ec2-4cd6-9cbd-daf0600d22dc service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:28.773819 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-4b34b456-88ee-410c-908e-88b7a4b458b6 req-9592d99d-0ec2-4cd6-9cbd-daf0600d22dc service nova] Creating event network-vif-deleted:32f744e1-43b5-4cbe-a3b6-9ee81f793879 for instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f on hv-cinder-80619 Aug 30 07:56:28.779202 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-4b34b456-88ee-410c-908e-88b7a4b458b6 req-9592d99d-0ec2-4cd6-9cbd-daf0600d22dc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033451 Aug 30 07:56:28.780025 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 537/1126] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:56:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:56:29.247475 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:29.248798 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:29.256484 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:29.257037 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:29.257864 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:29.258336 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:29.298894 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:29.299611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:29.300499 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lazy-loading 'fault' on Instance uuid 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:56:29.349786 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:29.364862 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:29.366429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:29.367596 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8bbacfd4-155d-4a37-9f7c-46b0ceb39108 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 200 len: 1370 microversion: 2.20 time: 0.126547 Aug 30 07:56:29.368164 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 590/1127] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:29 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 1370 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:56:30.387298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-062919e9-525e-44b1-a236-528df99efe3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:30.387990 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-062919e9-525e-44b1-a236-528df99efe3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:30.394046 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-062919e9-525e-44b1-a236-528df99efe3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:30.394520 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-062919e9-525e-44b1-a236-528df99efe3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:30.395278 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-062919e9-525e-44b1-a236-528df99efe3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:30.395709 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-062919e9-525e-44b1-a236-528df99efe3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:30.408684 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-062919e9-525e-44b1-a236-528df99efe3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] HTTP exception thrown: Instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f could not be found. Aug 30 07:56:30.409271 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-062919e9-525e-44b1-a236-528df99efe3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Returning 404 to user: Instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:56:30.410122 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-062919e9-525e-44b1-a236-528df99efe3e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 404 len: 111 microversion: 2.20 time: 0.027114 Aug 30 07:56:30.410948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 538/1128] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:30 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 07:56:30.419531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6737a218-9df8-4c1d-aae5-894cf4e95961 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '.version_select at 0x7f341c0c7ca0>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:30.442491 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6737a218-9df8-4c1d-aae5-894cf4e95961 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-311285817" status: 204 len: 0 microversion: 2.20 time: 0.027133 Aug 30 07:56:30.443101 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 591/1129] 10.222.0.73 () {60 vars in 1259 bytes} [Mon Aug 30 07:56:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-311285817 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 07:56:31.174992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4025d96d-47a6-4bd5-944d-6c13dc95f7f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'create', calling method: .version_select at 0x7f341c14c790>, body: {"keypair": {"name": "tempest-keypair-1224250265"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:31.193014 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-4025d96d-47a6-4bd5-944d-6c13dc95f7f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for project 46a024ebf24f430393b00d5d8777b746. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:56:31.196789 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-4025d96d-47a6-4bd5-944d-6c13dc95f7f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for user cd0b9269e5fb4c6fa880c5217149b229 and project 46a024ebf24f430393b00d5d8777b746. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:56:31.435566 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-32b3807b-355e-40e4-a756-d7c299422f13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:31.436755 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-32b3807b-355e-40e4-a756-d7c299422f13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:31.438268 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-4025d96d-47a6-4bd5-944d-6c13dc95f7f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for project 46a024ebf24f430393b00d5d8777b746. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:56:31.441858 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-4025d96d-47a6-4bd5-944d-6c13dc95f7f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for user cd0b9269e5fb4c6fa880c5217149b229 and project 46a024ebf24f430393b00d5d8777b746. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:56:31.442965 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32b3807b-355e-40e4-a756-d7c299422f13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:31.443484 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32b3807b-355e-40e4-a756-d7c299422f13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:31.444333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32b3807b-355e-40e4-a756-d7c299422f13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:31.444837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32b3807b-355e-40e4-a756-d7c299422f13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:31.455212 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4025d96d-47a6-4bd5-944d-6c13dc95f7f3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.283954 Aug 30 07:56:31.455808 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 539/1130] 10.222.0.73 () {62 vars in 1199 bytes} [Mon Aug 30 07:56:31 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 285 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 30 07:56:31.475078 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-32b3807b-355e-40e4-a756-d7c299422f13 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043310 Aug 30 07:56:31.475639 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 592/1131] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:56:31 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 07:56:31.539314 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c0cb4e6f-93eb-4953-bdfc-30e828154fa3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:31.539810 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c0cb4e6f-93eb-4953-bdfc-30e828154fa3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:31.546533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0cb4e6f-93eb-4953-bdfc-30e828154fa3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:31.546985 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0cb4e6f-93eb-4953-bdfc-30e828154fa3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:31.547764 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0cb4e6f-93eb-4953-bdfc-30e828154fa3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:31.548201 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0cb4e6f-93eb-4953-bdfc-30e828154fa3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:31.575975 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c0cb4e6f-93eb-4953-bdfc-30e828154fa3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Going to try to terminate instance {{(pid=114670) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:56:31.661132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c0cb4e6f-93eb-4953-bdfc-30e828154fa3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "DELETE /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 204 len: 0 microversion: 2.1 time: 0.125124 Aug 30 07:56:31.661742 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 540/1132] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:56:31 2021] DELETE /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:56:31.670162 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-632c6a87-26be-4489-a288-a6718f749929 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:31.671044 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-632c6a87-26be-4489-a288-a6718f749929 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:31.676816 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-632c6a87-26be-4489-a288-a6718f749929 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:31.677332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-632c6a87-26be-4489-a288-a6718f749929 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:31.678413 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-632c6a87-26be-4489-a288-a6718f749929 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:31.678912 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-632c6a87-26be-4489-a288-a6718f749929 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:31.865015 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-632c6a87-26be-4489-a288-a6718f749929 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:31.872546 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-632c6a87-26be-4489-a288-a6718f749929 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1670 microversion: 2.1 time: 0.206180 Aug 30 07:56:31.873117 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 593/1133] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:31 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1670 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:32.862088 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1103754952", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac8b0384-c5fa-4cad-beab-0f002d9bca24"}], "security_groups": [{"name": "tempest-securitygroup--1961407837"}], "key_name": "tempest-keypair-1224250265", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:32.888797 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0d313858-408d-477f-aa36-dd9452ab1296 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:32.889595 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0d313858-408d-477f-aa36-dd9452ab1296 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:32.895707 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d313858-408d-477f-aa36-dd9452ab1296 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:32.896157 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d313858-408d-477f-aa36-dd9452ab1296 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:32.896924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d313858-408d-477f-aa36-dd9452ab1296 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:32.897357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d313858-408d-477f-aa36-dd9452ab1296 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:32.970951 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] validate_networks() for [('ac8b0384-c5fa-4cad-beab-0f002d9bca24', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:56:33.022371 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0d313858-408d-477f-aa36-dd9452ab1296 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:33.030331 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0d313858-408d-477f-aa36-dd9452ab1296 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1670 microversion: 2.1 time: 0.145448 Aug 30 07:56:33.030906 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 594/1134] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:32 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1670 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:56:33.517813 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:56:33.518267 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:56:33.518742 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:56:33.519148 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:56:33.519556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:56:33.528423 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:33.528865 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:33.529658 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:33.530088 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:33.546213 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for project 46a024ebf24f430393b00d5d8777b746. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:56:33.550050 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Getting quotas for user cd0b9269e5fb4c6fa880c5217149b229 and project 46a024ebf24f430393b00d5d8777b746. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:56:33.561487 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:56:33.563993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:56:33.612711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ab414424-5d1c-433f-9699-d4bfd7d8b511 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.754960 Aug 30 07:56:33.613367 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 541/1135] 10.222.0.73 () {62 vars in 1188 bytes} [Mon Aug 30 07:56:32 2021] POST /compute/v2.1/servers => generated 402 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 07:56:33.623863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e6bf34f2-e985-4c64-b04b-5adf8c1d1275 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:33.624840 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e6bf34f2-e985-4c64-b04b-5adf8c1d1275 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:33.702996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e6bf34f2-e985-4c64-b04b-5adf8c1d1275 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:33.711052 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e6bf34f2-e985-4c64-b04b-5adf8c1d1275 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:33.712916 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e6bf34f2-e985-4c64-b04b-5adf8c1d1275 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:33.714196 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e6bf34f2-e985-4c64-b04b-5adf8c1d1275 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1282 microversion: 2.20 time: 0.094115 Aug 30 07:56:33.714770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 595/1136] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:33 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:56:34.048687 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c9b8fd30-f0a3-4213-8344-62cb8fc13822 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:34.049230 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c9b8fd30-f0a3-4213-8344-62cb8fc13822 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:34.055394 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c9b8fd30-f0a3-4213-8344-62cb8fc13822 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:34.055842 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c9b8fd30-f0a3-4213-8344-62cb8fc13822 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:34.056939 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c9b8fd30-f0a3-4213-8344-62cb8fc13822 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:34.057598 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c9b8fd30-f0a3-4213-8344-62cb8fc13822 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:34.148327 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c9b8fd30-f0a3-4213-8344-62cb8fc13822 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:34.157099 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c9b8fd30-f0a3-4213-8344-62cb8fc13822 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 200 len: 1603 microversion: 2.1 time: 0.112207 Aug 30 07:56:34.157668 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 542/1137] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:34 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 1603 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:34.424053 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-7cb072bb-1d3a-4b71-b407-e4b9ad4dd729 req-0edf6344-7ef9-4f7c-9dd8-4f199b1e2169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63042c8c-43ca-4d02-8ef2-07a08833cdf1", "name": "network-vif-deleted", "tag": "03f5aee7-d6fd-4ea0-b19a-d088da242d0e"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:34.425979 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:56:34.425979 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:56:34.435693 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-7cb072bb-1d3a-4b71-b407-e4b9ad4dd729 req-0edf6344-7ef9-4f7c-9dd8-4f199b1e2169 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:34.436140 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-7cb072bb-1d3a-4b71-b407-e4b9ad4dd729 req-0edf6344-7ef9-4f7c-9dd8-4f199b1e2169 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:34.458077 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-7cb072bb-1d3a-4b71-b407-e4b9ad4dd729 req-0edf6344-7ef9-4f7c-9dd8-4f199b1e2169 service nova] Creating event network-vif-deleted:03f5aee7-d6fd-4ea0-b19a-d088da242d0e for instance 63042c8c-43ca-4d02-8ef2-07a08833cdf1 on hv-cinder-80619 Aug 30 07:56:34.463122 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-7cb072bb-1d3a-4b71-b407-e4b9ad4dd729 req-0edf6344-7ef9-4f7c-9dd8-4f199b1e2169 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042795 Aug 30 07:56:34.463984 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 596/1138] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:56:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:56:34.732664 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2fb56456-464b-43e3-bbbc-16727d42c224 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:34.733273 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2fb56456-464b-43e3-bbbc-16727d42c224 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:34.740998 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2fb56456-464b-43e3-bbbc-16727d42c224 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:34.741849 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2fb56456-464b-43e3-bbbc-16727d42c224 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:34.743289 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2fb56456-464b-43e3-bbbc-16727d42c224 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:34.744501 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2fb56456-464b-43e3-bbbc-16727d42c224 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:34.827006 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2fb56456-464b-43e3-bbbc-16727d42c224 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:34.838248 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2fb56456-464b-43e3-bbbc-16727d42c224 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:34.840236 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2fb56456-464b-43e3-bbbc-16727d42c224 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:34.841468 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2fb56456-464b-43e3-bbbc-16727d42c224 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1340 microversion: 2.20 time: 0.113319 Aug 30 07:56:34.842524 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 543/1139] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:34 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1340 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:56:35.176479 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c110d8e6-c3af-4226-98da-3f03c6ab05bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:35.177492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c110d8e6-c3af-4226-98da-3f03c6ab05bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:35.186132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c110d8e6-c3af-4226-98da-3f03c6ab05bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:35.186808 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c110d8e6-c3af-4226-98da-3f03c6ab05bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:35.187603 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c110d8e6-c3af-4226-98da-3f03c6ab05bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:35.188235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c110d8e6-c3af-4226-98da-3f03c6ab05bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:35.202732 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-c110d8e6-c3af-4226-98da-3f03c6ab05bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] HTTP exception thrown: Instance 63042c8c-43ca-4d02-8ef2-07a08833cdf1 could not be found. Aug 30 07:56:35.203332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c110d8e6-c3af-4226-98da-3f03c6ab05bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Returning 404 to user: Instance 63042c8c-43ca-4d02-8ef2-07a08833cdf1 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:56:35.204432 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c110d8e6-c3af-4226-98da-3f03c6ab05bb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 404 len: 111 microversion: 2.1 time: 0.032724 Aug 30 07:56:35.204951 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 597/1140] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:35 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:56:35.215185 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-23ae437b-1cfb-4998-af25-522fb3a98d37 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '.version_select at 0x7f340ff54670>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:35.236386 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-23ae437b-1cfb-4998-af25-522fb3a98d37 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050634193" status: 202 len: 0 microversion: 2.1 time: 0.026474 Aug 30 07:56:35.237700 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 544/1141] 10.222.0.73 () {58 vars in 1221 bytes} [Mon Aug 30 07:56:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050634193 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:56:35.863181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fe6e283f-7644-400a-a8fb-911f400df4f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:35.865714 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fe6e283f-7644-400a-a8fb-911f400df4f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:35.875113 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe6e283f-7644-400a-a8fb-911f400df4f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:35.876127 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe6e283f-7644-400a-a8fb-911f400df4f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:35.877698 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe6e283f-7644-400a-a8fb-911f400df4f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:35.878460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe6e283f-7644-400a-a8fb-911f400df4f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:36.075952 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-fe6e283f-7644-400a-a8fb-911f400df4f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:36.091235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-fe6e283f-7644-400a-a8fb-911f400df4f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:36.093041 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-fe6e283f-7644-400a-a8fb-911f400df4f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:36.094371 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fe6e283f-7644-400a-a8fb-911f400df4f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1408 microversion: 2.20 time: 0.236267 Aug 30 07:56:36.095461 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 598/1142] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:35 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:56:36.118986 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b2d7c6e8-4a75-49ff-9152-76e83668ae60 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'create', calling method: .version_select at 0x7f340ff7ad30>, body: {"keypair": {"name": "tempest-keypair-1217063246"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:36.137301 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-b2d7c6e8-4a75-49ff-9152-76e83668ae60 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for project e71ca0134bc64db3b85a744bc5da948c. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:56:36.141176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-b2d7c6e8-4a75-49ff-9152-76e83668ae60 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for user c8eae3157f0344a6b8fe600144708a51 and project e71ca0134bc64db3b85a744bc5da948c. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:56:36.281415 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-b2d7c6e8-4a75-49ff-9152-76e83668ae60 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for project e71ca0134bc64db3b85a744bc5da948c. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:56:36.286183 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-b2d7c6e8-4a75-49ff-9152-76e83668ae60 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for user c8eae3157f0344a6b8fe600144708a51 and project e71ca0134bc64db3b85a744bc5da948c. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:56:36.299904 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b2d7c6e8-4a75-49ff-9152-76e83668ae60 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.185257 Aug 30 07:56:36.300880 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 545/1143] 10.222.0.73 () {60 vars in 1158 bytes} [Mon Aug 30 07:56:36 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:36.481245 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-813a2c6e-4b3d-4ac5-bd70-b932dfe2ab09 req-11ed562c-071d-40c3-84ec-048ebdd960a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04bba115-ffa4-48f5-9f97-30c8117579c2", "tag": "433de034-350e-4435-8de8-087595037325"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:36.482841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:56:36.482841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:56:36.490365 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-813a2c6e-4b3d-4ac5-bd70-b932dfe2ab09 req-11ed562c-071d-40c3-84ec-048ebdd960a4 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:36.490815 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-813a2c6e-4b3d-4ac5-bd70-b932dfe2ab09 req-11ed562c-071d-40c3-84ec-048ebdd960a4 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:36.502988 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-813a2c6e-4b3d-4ac5-bd70-b932dfe2ab09 req-11ed562c-071d-40c3-84ec-048ebdd960a4 service nova] Creating event network-changed:433de034-350e-4435-8de8-087595037325 for instance 04bba115-ffa4-48f5-9f97-30c8117579c2 on hv-cinder-80619 Aug 30 07:56:36.508458 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-813a2c6e-4b3d-4ac5-bd70-b932dfe2ab09 req-11ed562c-071d-40c3-84ec-048ebdd960a4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032101 Aug 30 07:56:36.510282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 599/1144] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:56:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:56:36.511225 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d221837b-2df2-4859-80d9-5e483bbcf239 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:36.512210 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d221837b-2df2-4859-80d9-5e483bbcf239 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:36.518878 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d221837b-2df2-4859-80d9-5e483bbcf239 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:36.519367 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d221837b-2df2-4859-80d9-5e483bbcf239 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:36.520457 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d221837b-2df2-4859-80d9-5e483bbcf239 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:36.520922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d221837b-2df2-4859-80d9-5e483bbcf239 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:36.595740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d221837b-2df2-4859-80d9-5e483bbcf239 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "POST /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/action" status: 202 len: 0 microversion: 2.1 time: 0.090494 Aug 30 07:56:36.599223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 546/1145] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:56:36 2021] POST /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:56:36.605611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7172ba4b-f754-4ac3-b3a1-2fd6161c88d8 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:36.606541 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7172ba4b-f754-4ac3-b3a1-2fd6161c88d8 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:36.612835 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7172ba4b-f754-4ac3-b3a1-2fd6161c88d8 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:36.613441 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7172ba4b-f754-4ac3-b3a1-2fd6161c88d8 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:36.614186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7172ba4b-f754-4ac3-b3a1-2fd6161c88d8 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:36.614708 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7172ba4b-f754-4ac3-b3a1-2fd6161c88d8 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:36.755882 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7172ba4b-f754-4ac3-b3a1-2fd6161c88d8 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:36.764492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7172ba4b-f754-4ac3-b3a1-2fd6161c88d8 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1753 microversion: 2.1 time: 0.163636 Aug 30 07:56:36.765089 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 600/1146] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:36 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:56:37.117543 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-73f42487-132a-4a5d-9290-d6219b45a162 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:37.118463 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-73f42487-132a-4a5d-9290-d6219b45a162 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:37.125211 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73f42487-132a-4a5d-9290-d6219b45a162 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:37.125802 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73f42487-132a-4a5d-9290-d6219b45a162 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:37.126742 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73f42487-132a-4a5d-9290-d6219b45a162 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:37.127373 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73f42487-132a-4a5d-9290-d6219b45a162 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:37.451558 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-73f42487-132a-4a5d-9290-d6219b45a162 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:37.461031 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-73f42487-132a-4a5d-9290-d6219b45a162 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:37.463209 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-73f42487-132a-4a5d-9290-d6219b45a162 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:37.464529 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-73f42487-132a-4a5d-9290-d6219b45a162 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1408 microversion: 2.20 time: 0.351317 Aug 30 07:56:37.465090 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 547/1147] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:37 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:56:37.782235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9f1e066d-6acb-4309-ac0d-c5edc999f72f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:37.782983 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9f1e066d-6acb-4309-ac0d-c5edc999f72f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:37.787162 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-121262453", "imageRef": "4d944cb8-5725-4713-b186-7d9970617849", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0b6d139-5ec8-4ecd-be42-a32d8b014bf5"}], "security_groups": [{"name": "tempest-securitygroup--1163367194"}], "key_name": "tempest-keypair-1217063246", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:37.789858 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9f1e066d-6acb-4309-ac0d-c5edc999f72f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:37.791000 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9f1e066d-6acb-4309-ac0d-c5edc999f72f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:37.791900 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9f1e066d-6acb-4309-ac0d-c5edc999f72f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:37.792473 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9f1e066d-6acb-4309-ac0d-c5edc999f72f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:37.883129 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] validate_networks() for [('c0b6d139-5ec8-4ecd-be42-a32d8b014bf5', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:56:37.928220 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9f1e066d-6acb-4309-ac0d-c5edc999f72f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:37.937411 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9f1e066d-6acb-4309-ac0d-c5edc999f72f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1758 microversion: 2.1 time: 0.159057 Aug 30 07:56:37.938126 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 601/1148] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:37 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:38.481946 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a5f049f7-8f71-412e-9a01-e9cd261c6b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:38.482600 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a5f049f7-8f71-412e-9a01-e9cd261c6b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:38.488676 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a5f049f7-8f71-412e-9a01-e9cd261c6b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:38.489131 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a5f049f7-8f71-412e-9a01-e9cd261c6b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:38.489902 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a5f049f7-8f71-412e-9a01-e9cd261c6b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:38.490367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a5f049f7-8f71-412e-9a01-e9cd261c6b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:38.505373 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:56:38.505887 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:56:38.506322 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:56:38.506737 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:56:38.507151 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:56:38.516192 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:38.516639 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:38.517439 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:38.517874 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:38.535889 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for project e71ca0134bc64db3b85a744bc5da948c. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:56:38.539999 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Getting quotas for user c8eae3157f0344a6b8fe600144708a51 and project e71ca0134bc64db3b85a744bc5da948c. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:56:38.551393 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:56:38.553736 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d944cb8-5725-4713-b186-7d9970617849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:56:38.606800 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-92f2d623-8b5d-45c3-9c12-e457a44ccd01 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.823368 Aug 30 07:56:38.612477 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 548/1149] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:56:37 2021] POST /compute/v2.1/servers => generated 402 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 07:56:38.617750 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-680466aa-f49b-4710-8699-b01c11c450e7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:38.618974 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-680466aa-f49b-4710-8699-b01c11c450e7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:38.619974 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a5f049f7-8f71-412e-9a01-e9cd261c6b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:38.633585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a5f049f7-8f71-412e-9a01-e9cd261c6b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:38.636378 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a5f049f7-8f71-412e-9a01-e9cd261c6b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:38.637987 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a5f049f7-8f71-412e-9a01-e9cd261c6b0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1408 microversion: 2.20 time: 0.160139 Aug 30 07:56:38.638602 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 602/1150] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:38 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:56:38.676969 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-680466aa-f49b-4710-8699-b01c11c450e7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:38.685655 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-680466aa-f49b-4710-8699-b01c11c450e7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1237 microversion: 2.1 time: 0.071784 Aug 30 07:56:38.686346 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 549/1151] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:38 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:38.955904 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8a59496f-bb86-419a-b67e-cfa54af8200e tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:38.956793 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8a59496f-bb86-419a-b67e-cfa54af8200e tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:38.964278 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8a59496f-bb86-419a-b67e-cfa54af8200e tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:38.964962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8a59496f-bb86-419a-b67e-cfa54af8200e tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:38.965889 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8a59496f-bb86-419a-b67e-cfa54af8200e tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:38.966462 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8a59496f-bb86-419a-b67e-cfa54af8200e tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:39.099118 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8a59496f-bb86-419a-b67e-cfa54af8200e tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:39.108087 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8a59496f-bb86-419a-b67e-cfa54af8200e tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1758 microversion: 2.1 time: 0.156300 Aug 30 07:56:39.108709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 603/1152] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:38 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1758 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:39.655383 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ed0610ca-54cb-4e35-9e33-ba500758a668 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:39.656089 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ed0610ca-54cb-4e35-9e33-ba500758a668 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:39.664797 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed0610ca-54cb-4e35-9e33-ba500758a668 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:39.665364 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed0610ca-54cb-4e35-9e33-ba500758a668 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:39.666179 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed0610ca-54cb-4e35-9e33-ba500758a668 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:39.666751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ed0610ca-54cb-4e35-9e33-ba500758a668 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:39.703936 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-76dfa5be-0df5-4039-9791-ce844b2d91e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:39.705120 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-76dfa5be-0df5-4039-9791-ce844b2d91e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:39.711203 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-76dfa5be-0df5-4039-9791-ce844b2d91e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:39.711762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-76dfa5be-0df5-4039-9791-ce844b2d91e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:39.712719 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-76dfa5be-0df5-4039-9791-ce844b2d91e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:39.713690 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-76dfa5be-0df5-4039-9791-ce844b2d91e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:39.779688 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-76dfa5be-0df5-4039-9791-ce844b2d91e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:39.787697 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-76dfa5be-0df5-4039-9791-ce844b2d91e2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1297 microversion: 2.1 time: 0.087567 Aug 30 07:56:39.788275 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 604/1153] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:39 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:56:39.874328 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ed0610ca-54cb-4e35-9e33-ba500758a668 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:39.882715 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ed0610ca-54cb-4e35-9e33-ba500758a668 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:39.884771 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ed0610ca-54cb-4e35-9e33-ba500758a668 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:39.885888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ed0610ca-54cb-4e35-9e33-ba500758a668 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1408 microversion: 2.20 time: 0.234293 Aug 30 07:56:39.886514 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 550/1154] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:39 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:56:40.125991 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8caad2b5-3eff-4724-829f-f5760e72963c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:40.126617 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8caad2b5-3eff-4724-829f-f5760e72963c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:40.132332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8caad2b5-3eff-4724-829f-f5760e72963c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:40.132777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8caad2b5-3eff-4724-829f-f5760e72963c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:40.133546 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8caad2b5-3eff-4724-829f-f5760e72963c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:40.134831 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8caad2b5-3eff-4724-829f-f5760e72963c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:40.260297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8caad2b5-3eff-4724-829f-f5760e72963c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:40.268080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8caad2b5-3eff-4724-829f-f5760e72963c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1758 microversion: 2.1 time: 0.145736 Aug 30 07:56:40.268848 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 605/1155] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:40 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1758 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:40.788813 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-4f299cba-266f-4176-81fb-4fb3ddf80698 req-bfddf945-504f-4360-a2b6-11c67a04d870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bba115-ffa4-48f5-9f97-30c8117579c2", "name": "network-vif-plugged", "status": "completed", "tag": "433de034-350e-4435-8de8-087595037325"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:40.790899 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:56:40.790899 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:56:40.799000 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-4f299cba-266f-4176-81fb-4fb3ddf80698 req-bfddf945-504f-4360-a2b6-11c67a04d870 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:40.799441 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-4f299cba-266f-4176-81fb-4fb3ddf80698 req-bfddf945-504f-4360-a2b6-11c67a04d870 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:40.806638 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d7ef424f-88ae-45ad-bdeb-29b9e3f7deeb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:40.807816 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d7ef424f-88ae-45ad-bdeb-29b9e3f7deeb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:40.815925 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d7ef424f-88ae-45ad-bdeb-29b9e3f7deeb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:40.816892 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d7ef424f-88ae-45ad-bdeb-29b9e3f7deeb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:40.817939 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d7ef424f-88ae-45ad-bdeb-29b9e3f7deeb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:40.818963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d7ef424f-88ae-45ad-bdeb-29b9e3f7deeb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:40.821820 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-4f299cba-266f-4176-81fb-4fb3ddf80698 req-bfddf945-504f-4360-a2b6-11c67a04d870 service nova] Creating event network-vif-plugged:433de034-350e-4435-8de8-087595037325 for instance 04bba115-ffa4-48f5-9f97-30c8117579c2 on hv-cinder-80619 Aug 30 07:56:40.828370 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-4f299cba-266f-4176-81fb-4fb3ddf80698 req-bfddf945-504f-4360-a2b6-11c67a04d870 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043006 Aug 30 07:56:40.829378 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 551/1156] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:56:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:56:40.906374 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6bce0f4b-ffa6-4b03-b44b-ba8dd34c3e52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:40.907256 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6bce0f4b-ffa6-4b03-b44b-ba8dd34c3e52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:40.916496 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bce0f4b-ffa6-4b03-b44b-ba8dd34c3e52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:40.917156 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bce0f4b-ffa6-4b03-b44b-ba8dd34c3e52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:40.918120 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bce0f4b-ffa6-4b03-b44b-ba8dd34c3e52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:40.918746 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6bce0f4b-ffa6-4b03-b44b-ba8dd34c3e52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:41.032332 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d7ef424f-88ae-45ad-bdeb-29b9e3f7deeb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:41.043995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d7ef424f-88ae-45ad-bdeb-29b9e3f7deeb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1363 microversion: 2.1 time: 0.242245 Aug 30 07:56:41.044901 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 606/1157] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:40 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:41.222855 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6bce0f4b-ffa6-4b03-b44b-ba8dd34c3e52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:41.233549 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6bce0f4b-ffa6-4b03-b44b-ba8dd34c3e52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:41.235075 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6bce0f4b-ffa6-4b03-b44b-ba8dd34c3e52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:41.236157 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6bce0f4b-ffa6-4b03-b44b-ba8dd34c3e52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1408 microversion: 2.20 time: 0.334455 Aug 30 07:56:41.237265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 552/1158] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:40 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1408 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:56:41.286202 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7b6b9fa9-6223-4911-a8f9-255bceb3ce18 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:41.286985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7b6b9fa9-6223-4911-a8f9-255bceb3ce18 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:41.293521 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b6b9fa9-6223-4911-a8f9-255bceb3ce18 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:41.294034 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b6b9fa9-6223-4911-a8f9-255bceb3ce18 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:41.295359 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b6b9fa9-6223-4911-a8f9-255bceb3ce18 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:41.296024 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7b6b9fa9-6223-4911-a8f9-255bceb3ce18 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:41.303703 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-cd0b42b4-23c9-4cb4-b7bd-aadc9cb9a803 req-ff334401-c06a-4324-9bfa-028e09a4a34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eb1895f-02c2-4252-a5ba-f3c6496dfa4d", "tag": "fe883039-4227-47ba-89b3-d8497a08c086"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:41.306131 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:56:41.306131 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:56:41.314509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-cd0b42b4-23c9-4cb4-b7bd-aadc9cb9a803 req-ff334401-c06a-4324-9bfa-028e09a4a34b service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:41.315104 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-cd0b42b4-23c9-4cb4-b7bd-aadc9cb9a803 req-ff334401-c06a-4324-9bfa-028e09a4a34b service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:41.327222 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-cd0b42b4-23c9-4cb4-b7bd-aadc9cb9a803 req-ff334401-c06a-4324-9bfa-028e09a4a34b service nova] Creating event network-changed:fe883039-4227-47ba-89b3-d8497a08c086 for instance 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d on hv-cinder-80619 Aug 30 07:56:41.333357 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-cd0b42b4-23c9-4cb4-b7bd-aadc9cb9a803 req-ff334401-c06a-4324-9bfa-028e09a4a34b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033447 Aug 30 07:56:41.334184 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 553/1159] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:56:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:56:41.437471 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7b6b9fa9-6223-4911-a8f9-255bceb3ce18 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:41.445685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7b6b9fa9-6223-4911-a8f9-255bceb3ce18 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1758 microversion: 2.1 time: 0.164793 Aug 30 07:56:41.446321 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 607/1160] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:41 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:42.062610 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-59b6bd0f-bb5b-4a77-a4e1-d952a0f97b4c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:42.063307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-59b6bd0f-bb5b-4a77-a4e1-d952a0f97b4c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:42.069307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59b6bd0f-bb5b-4a77-a4e1-d952a0f97b4c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:42.069751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59b6bd0f-bb5b-4a77-a4e1-d952a0f97b4c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:42.070547 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59b6bd0f-bb5b-4a77-a4e1-d952a0f97b4c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:42.070977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59b6bd0f-bb5b-4a77-a4e1-d952a0f97b4c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:42.255968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1d83ee64-cfd8-4f86-8bcf-6c2e92148a37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:42.256595 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1d83ee64-cfd8-4f86-8bcf-6c2e92148a37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:42.264034 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d83ee64-cfd8-4f86-8bcf-6c2e92148a37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:42.264494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d83ee64-cfd8-4f86-8bcf-6c2e92148a37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:42.265295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d83ee64-cfd8-4f86-8bcf-6c2e92148a37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:42.265729 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d83ee64-cfd8-4f86-8bcf-6c2e92148a37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:42.265837 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-59b6bd0f-bb5b-4a77-a4e1-d952a0f97b4c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:42.273271 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-59b6bd0f-bb5b-4a77-a4e1-d952a0f97b4c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1363 microversion: 2.1 time: 0.214733 Aug 30 07:56:42.273834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 554/1161] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:42 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:42.388103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1d83ee64-cfd8-4f86-8bcf-6c2e92148a37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:42.396174 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1d83ee64-cfd8-4f86-8bcf-6c2e92148a37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:42.397945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1d83ee64-cfd8-4f86-8bcf-6c2e92148a37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:42.399841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1d83ee64-cfd8-4f86-8bcf-6c2e92148a37 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1408 microversion: 2.20 time: 0.147931 Aug 30 07:56:42.400566 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 608/1162] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:42 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:56:42.462955 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7ed69b82-c095-4183-922e-dd4132284840 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:42.463566 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7ed69b82-c095-4183-922e-dd4132284840 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:42.469556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7ed69b82-c095-4183-922e-dd4132284840 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:42.470007 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7ed69b82-c095-4183-922e-dd4132284840 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:42.470825 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7ed69b82-c095-4183-922e-dd4132284840 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:42.471257 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7ed69b82-c095-4183-922e-dd4132284840 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:42.596109 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7ed69b82-c095-4183-922e-dd4132284840 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:42.605099 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7ed69b82-c095-4183-922e-dd4132284840 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1758 microversion: 2.1 time: 0.146311 Aug 30 07:56:42.611180 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 555/1163] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:42 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1758 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:43.290976 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-17192cb9-0e0e-44c1-85c1-e733e2bceda9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:43.291509 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-17192cb9-0e0e-44c1-85c1-e733e2bceda9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:43.297410 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17192cb9-0e0e-44c1-85c1-e733e2bceda9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:43.297863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17192cb9-0e0e-44c1-85c1-e733e2bceda9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:43.298659 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17192cb9-0e0e-44c1-85c1-e733e2bceda9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:43.299094 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-17192cb9-0e0e-44c1-85c1-e733e2bceda9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:43.419015 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bed906d9-b645-45d8-833e-6d82393d450a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:43.419661 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bed906d9-b645-45d8-833e-6d82393d450a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:43.421888 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-17192cb9-0e0e-44c1-85c1-e733e2bceda9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:43.425571 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bed906d9-b645-45d8-833e-6d82393d450a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:43.426097 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bed906d9-b645-45d8-833e-6d82393d450a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:43.427241 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bed906d9-b645-45d8-833e-6d82393d450a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:43.428181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bed906d9-b645-45d8-833e-6d82393d450a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:43.429133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-17192cb9-0e0e-44c1-85c1-e733e2bceda9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1363 microversion: 2.1 time: 0.142658 Aug 30 07:56:43.429711 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 609/1164] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:43 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:43.552252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-bed906d9-b645-45d8-833e-6d82393d450a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:43.560150 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-bed906d9-b645-45d8-833e-6d82393d450a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:43.561645 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-bed906d9-b645-45d8-833e-6d82393d450a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:43.562825 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bed906d9-b645-45d8-833e-6d82393d450a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1599 microversion: 2.20 time: 0.148362 Aug 30 07:56:43.563380 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 556/1165] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:56:43 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:56:43.579946 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-45126150-21d1-4a8f-9589-74a94716d619 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:43.580442 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-45126150-21d1-4a8f-9589-74a94716d619 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:43.586227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-45126150-21d1-4a8f-9589-74a94716d619 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:43.587202 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-45126150-21d1-4a8f-9589-74a94716d619 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:43.587968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-45126150-21d1-4a8f-9589-74a94716d619 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:43.588402 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-45126150-21d1-4a8f-9589-74a94716d619 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:43.626077 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-53977204-6bf8-4eb4-a327-f65fd4ca5e9d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:43.626848 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-53977204-6bf8-4eb4-a327-f65fd4ca5e9d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:43.632836 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-53977204-6bf8-4eb4-a327-f65fd4ca5e9d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:43.633277 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-53977204-6bf8-4eb4-a327-f65fd4ca5e9d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:43.634601 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-53977204-6bf8-4eb4-a327-f65fd4ca5e9d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:43.635029 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-53977204-6bf8-4eb4-a327-f65fd4ca5e9d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:43.668392 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-45126150-21d1-4a8f-9589-74a94716d619 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092100 Aug 30 07:56:43.668988 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 610/1166] 10.222.0.73 () {60 vars in 1316 bytes} [Mon Aug 30 07:56:43 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:56:43.768672 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-53977204-6bf8-4eb4-a327-f65fd4ca5e9d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:43.778279 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-53977204-6bf8-4eb4-a327-f65fd4ca5e9d tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1758 microversion: 2.1 time: 0.159249 Aug 30 07:56:43.778876 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 557/1167] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:43 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:56:44.446743 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c9e9c2e7-2663-4645-ac0f-572e565b79f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:44.447470 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c9e9c2e7-2663-4645-ac0f-572e565b79f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:44.453613 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9e9c2e7-2663-4645-ac0f-572e565b79f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:44.454089 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9e9c2e7-2663-4645-ac0f-572e565b79f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:44.456997 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9e9c2e7-2663-4645-ac0f-572e565b79f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:44.456997 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c9e9c2e7-2663-4645-ac0f-572e565b79f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:44.712270 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c9e9c2e7-2663-4645-ac0f-572e565b79f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:44.719453 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c9e9c2e7-2663-4645-ac0f-572e565b79f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1363 microversion: 2.1 time: 0.277071 Aug 30 07:56:44.720019 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 611/1168] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:44 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:44.796264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9247c50d-68d3-4f31-a262-aab7e11150cc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:44.796975 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9247c50d-68d3-4f31-a262-aab7e11150cc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:44.803821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9247c50d-68d3-4f31-a262-aab7e11150cc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:44.804257 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9247c50d-68d3-4f31-a262-aab7e11150cc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:44.805771 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9247c50d-68d3-4f31-a262-aab7e11150cc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:44.806535 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9247c50d-68d3-4f31-a262-aab7e11150cc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:44.934800 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9247c50d-68d3-4f31-a262-aab7e11150cc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:44.942587 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9247c50d-68d3-4f31-a262-aab7e11150cc tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1758 microversion: 2.1 time: 0.150344 Aug 30 07:56:44.943228 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 558/1169] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:44 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1758 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:56:45.093803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-304d0ed8-ffb8-40de-80f9-f656e452053c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:45.094827 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-304d0ed8-ffb8-40de-80f9-f656e452053c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:45.095994 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-e43acbaa-ee0d-401c-93fb-43852f390210 req-6327fef3-816d-48b4-82a6-8fec98946f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04bba115-ffa4-48f5-9f97-30c8117579c2", "tag": "433de034-350e-4435-8de8-087595037325"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:45.097804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:56:45.097804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:56:45.101389 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-304d0ed8-ffb8-40de-80f9-f656e452053c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:45.101958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-304d0ed8-ffb8-40de-80f9-f656e452053c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:45.103256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-304d0ed8-ffb8-40de-80f9-f656e452053c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:45.103796 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-304d0ed8-ffb8-40de-80f9-f656e452053c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:45.104178 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-e43acbaa-ee0d-401c-93fb-43852f390210 req-6327fef3-816d-48b4-82a6-8fec98946f8e service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:45.104874 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-e43acbaa-ee0d-401c-93fb-43852f390210 req-6327fef3-816d-48b4-82a6-8fec98946f8e service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:45.119749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-e43acbaa-ee0d-401c-93fb-43852f390210 req-6327fef3-816d-48b4-82a6-8fec98946f8e service nova] Creating event network-changed:433de034-350e-4435-8de8-087595037325 for instance 04bba115-ffa4-48f5-9f97-30c8117579c2 on hv-cinder-80619 Aug 30 07:56:45.123751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-e43acbaa-ee0d-401c-93fb-43852f390210 req-6327fef3-816d-48b4-82a6-8fec98946f8e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031243 Aug 30 07:56:45.124348 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 559/1170] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:56:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:56:45.170813 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-304d0ed8-ffb8-40de-80f9-f656e452053c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 14 microversion: 2.20 time: 0.080464 Aug 30 07:56:45.171641 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 612/1171] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:45 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:45.738527 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e8e81cce-b85e-46fd-a2e5-02e88cbd87f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:45.739541 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e8e81cce-b85e-46fd-a2e5-02e88cbd87f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:45.748149 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e8e81cce-b85e-46fd-a2e5-02e88cbd87f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:45.748596 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e8e81cce-b85e-46fd-a2e5-02e88cbd87f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:45.749383 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e8e81cce-b85e-46fd-a2e5-02e88cbd87f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:45.749849 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e8e81cce-b85e-46fd-a2e5-02e88cbd87f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:45.891886 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e8e81cce-b85e-46fd-a2e5-02e88cbd87f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:45.903855 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e8e81cce-b85e-46fd-a2e5-02e88cbd87f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1363 microversion: 2.1 time: 0.170797 Aug 30 07:56:45.904866 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 560/1172] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:45 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:45.961458 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a80e80b7-ed25-4208-ad06-119db557a17b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:45.963088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a80e80b7-ed25-4208-ad06-119db557a17b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:45.971780 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a80e80b7-ed25-4208-ad06-119db557a17b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:45.972234 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a80e80b7-ed25-4208-ad06-119db557a17b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:45.973017 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a80e80b7-ed25-4208-ad06-119db557a17b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:45.973456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a80e80b7-ed25-4208-ad06-119db557a17b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:46.108973 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a80e80b7-ed25-4208-ad06-119db557a17b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:46.118540 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a80e80b7-ed25-4208-ad06-119db557a17b tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1758 microversion: 2.1 time: 0.161262 Aug 30 07:56:46.119132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 613/1173] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:45 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:46.183883 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c7eaee21-053f-449d-9b47-8d8e12db363d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:46.185509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c7eaee21-053f-449d-9b47-8d8e12db363d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:46.194326 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c7eaee21-053f-449d-9b47-8d8e12db363d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:46.195352 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c7eaee21-053f-449d-9b47-8d8e12db363d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:46.197415 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c7eaee21-053f-449d-9b47-8d8e12db363d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:46.198356 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c7eaee21-053f-449d-9b47-8d8e12db363d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:46.257561 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c7eaee21-053f-449d-9b47-8d8e12db363d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 14 microversion: 2.20 time: 0.079845 Aug 30 07:56:46.258345 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 561/1174] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:46 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:46.928279 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-94d863d7-1bab-4532-b91c-4b8f912c59e8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:46.928885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-94d863d7-1bab-4532-b91c-4b8f912c59e8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:46.935495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-94d863d7-1bab-4532-b91c-4b8f912c59e8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:46.935934 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-94d863d7-1bab-4532-b91c-4b8f912c59e8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:46.936685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-94d863d7-1bab-4532-b91c-4b8f912c59e8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:46.937107 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-94d863d7-1bab-4532-b91c-4b8f912c59e8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:47.069018 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-94d863d7-1bab-4532-b91c-4b8f912c59e8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:47.076161 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-94d863d7-1bab-4532-b91c-4b8f912c59e8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1363 microversion: 2.1 time: 0.151536 Aug 30 07:56:47.076886 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 614/1175] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:46 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:47.139043 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0887653e-08f8-4bf5-af83-a18fdb1d94df tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:47.139749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0887653e-08f8-4bf5-af83-a18fdb1d94df tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:47.146533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0887653e-08f8-4bf5-af83-a18fdb1d94df tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:47.146987 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0887653e-08f8-4bf5-af83-a18fdb1d94df tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:47.147773 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0887653e-08f8-4bf5-af83-a18fdb1d94df tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:47.148212 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0887653e-08f8-4bf5-af83-a18fdb1d94df tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:47.270045 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-10ebcc22-4ddb-4d43-aaa0-dad81f8daf28 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:47.271123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-10ebcc22-4ddb-4d43-aaa0-dad81f8daf28 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:47.278309 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-10ebcc22-4ddb-4d43-aaa0-dad81f8daf28 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:47.278766 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-10ebcc22-4ddb-4d43-aaa0-dad81f8daf28 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:47.279559 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-10ebcc22-4ddb-4d43-aaa0-dad81f8daf28 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:47.279987 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-10ebcc22-4ddb-4d43-aaa0-dad81f8daf28 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:47.280477 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0887653e-08f8-4bf5-af83-a18fdb1d94df tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:47.288455 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0887653e-08f8-4bf5-af83-a18fdb1d94df tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1758 microversion: 2.1 time: 0.153473 Aug 30 07:56:47.289037 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 562/1176] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:47 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1758 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:47.342913 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-10ebcc22-4ddb-4d43-aaa0-dad81f8daf28 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 14 microversion: 2.20 time: 0.077195 Aug 30 07:56:47.343560 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 615/1177] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:47 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:56:48.092997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-060cbc82-0dc2-40fe-9888-6c28a3f89e7c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:48.093610 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-060cbc82-0dc2-40fe-9888-6c28a3f89e7c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:48.099473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-060cbc82-0dc2-40fe-9888-6c28a3f89e7c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:48.099928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-060cbc82-0dc2-40fe-9888-6c28a3f89e7c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:48.100681 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-060cbc82-0dc2-40fe-9888-6c28a3f89e7c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:48.101111 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-060cbc82-0dc2-40fe-9888-6c28a3f89e7c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:48.225214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-060cbc82-0dc2-40fe-9888-6c28a3f89e7c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:48.233495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-060cbc82-0dc2-40fe-9888-6c28a3f89e7c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1363 microversion: 2.1 time: 0.144061 Aug 30 07:56:48.234072 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 563/1178] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:48 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:48.307831 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e6d1da5d-dc7c-4e3d-848a-dc0545262a9c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:48.308536 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e6d1da5d-dc7c-4e3d-848a-dc0545262a9c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:48.315202 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6d1da5d-dc7c-4e3d-848a-dc0545262a9c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:48.315644 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6d1da5d-dc7c-4e3d-848a-dc0545262a9c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:48.316416 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6d1da5d-dc7c-4e3d-848a-dc0545262a9c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:48.316846 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6d1da5d-dc7c-4e3d-848a-dc0545262a9c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:48.355432 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b0dc4c07-d2db-4087-9b77-c0dd38fc8ee2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:48.356345 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b0dc4c07-d2db-4087-9b77-c0dd38fc8ee2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:48.362360 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0dc4c07-d2db-4087-9b77-c0dd38fc8ee2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:48.362866 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0dc4c07-d2db-4087-9b77-c0dd38fc8ee2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:48.363722 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0dc4c07-d2db-4087-9b77-c0dd38fc8ee2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:48.364160 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b0dc4c07-d2db-4087-9b77-c0dd38fc8ee2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:48.426107 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b0dc4c07-d2db-4087-9b77-c0dd38fc8ee2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 14 microversion: 2.20 time: 0.075195 Aug 30 07:56:48.429689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 564/1179] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:48 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:56:48.448174 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e6d1da5d-dc7c-4e3d-848a-dc0545262a9c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:48.456273 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e6d1da5d-dc7c-4e3d-848a-dc0545262a9c tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1758 microversion: 2.1 time: 0.153314 Aug 30 07:56:48.456872 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 616/1180] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:48 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1758 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:48.785097 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-ccee6ff8-35ed-44df-b784-a55bfdd867eb req-e0f8ee42-2e45-41b1-88b3-4a28364a07f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb1895f-02c2-4252-a5ba-f3c6496dfa4d", "name": "network-vif-plugged", "status": "completed", "tag": "fe883039-4227-47ba-89b3-d8497a08c086"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:48.786666 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:56:48.786666 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:56:48.795476 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-ccee6ff8-35ed-44df-b784-a55bfdd867eb req-e0f8ee42-2e45-41b1-88b3-4a28364a07f9 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:48.796043 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-ccee6ff8-35ed-44df-b784-a55bfdd867eb req-e0f8ee42-2e45-41b1-88b3-4a28364a07f9 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:48.807989 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-ccee6ff8-35ed-44df-b784-a55bfdd867eb req-e0f8ee42-2e45-41b1-88b3-4a28364a07f9 service nova] Creating event network-vif-plugged:fe883039-4227-47ba-89b3-d8497a08c086 for instance 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d on hv-cinder-80619 Aug 30 07:56:48.812674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-ccee6ff8-35ed-44df-b784-a55bfdd867eb req-e0f8ee42-2e45-41b1-88b3-4a28364a07f9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031547 Aug 30 07:56:48.813407 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 565/1181] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:56:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:56:49.251210 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-573cb22f-158c-4deb-a3c2-223690379286 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:49.251814 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-573cb22f-158c-4deb-a3c2-223690379286 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:49.257782 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-573cb22f-158c-4deb-a3c2-223690379286 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:49.258615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-573cb22f-158c-4deb-a3c2-223690379286 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:49.259378 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-573cb22f-158c-4deb-a3c2-223690379286 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:49.259840 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-573cb22f-158c-4deb-a3c2-223690379286 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:49.378235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-573cb22f-158c-4deb-a3c2-223690379286 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:49.386102 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-573cb22f-158c-4deb-a3c2-223690379286 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1363 microversion: 2.1 time: 0.138952 Aug 30 07:56:49.386685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 617/1182] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:49 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:49.437276 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ee0bcc62-94e7-4a09-90d1-544bfc63dddc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:49.438293 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ee0bcc62-94e7-4a09-90d1-544bfc63dddc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:49.444344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ee0bcc62-94e7-4a09-90d1-544bfc63dddc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:49.444790 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ee0bcc62-94e7-4a09-90d1-544bfc63dddc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:49.445619 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ee0bcc62-94e7-4a09-90d1-544bfc63dddc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:49.446120 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ee0bcc62-94e7-4a09-90d1-544bfc63dddc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:49.474531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d6daaffb-342f-4cb9-8121-c2cdcc08e2f5 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:49.475143 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d6daaffb-342f-4cb9-8121-c2cdcc08e2f5 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:49.482098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6daaffb-342f-4cb9-8121-c2cdcc08e2f5 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:49.482571 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6daaffb-342f-4cb9-8121-c2cdcc08e2f5 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:49.483325 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6daaffb-342f-4cb9-8121-c2cdcc08e2f5 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:49.483752 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d6daaffb-342f-4cb9-8121-c2cdcc08e2f5 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:49.519425 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ee0bcc62-94e7-4a09-90d1-544bfc63dddc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 14 microversion: 2.20 time: 0.085828 Aug 30 07:56:49.520399 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 566/1183] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:49 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:49.610068 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d6daaffb-342f-4cb9-8121-c2cdcc08e2f5 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:49.618879 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d6daaffb-342f-4cb9-8121-c2cdcc08e2f5 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1761 microversion: 2.1 time: 0.148494 Aug 30 07:56:49.619468 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 618/1184] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:49 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1761 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:56:50.408135 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-55599a54-f9de-4ece-b223-5d2420e0462c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:50.409402 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-55599a54-f9de-4ece-b223-5d2420e0462c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:50.421041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-55599a54-f9de-4ece-b223-5d2420e0462c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:50.421794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-55599a54-f9de-4ece-b223-5d2420e0462c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:50.423193 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-55599a54-f9de-4ece-b223-5d2420e0462c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:50.423954 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-55599a54-f9de-4ece-b223-5d2420e0462c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:50.531410 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bfb86bb0-8706-4145-b888-bd6b718db4b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:50.532508 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bfb86bb0-8706-4145-b888-bd6b718db4b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:50.538316 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bfb86bb0-8706-4145-b888-bd6b718db4b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:50.538772 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bfb86bb0-8706-4145-b888-bd6b718db4b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:50.540161 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bfb86bb0-8706-4145-b888-bd6b718db4b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:50.540614 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bfb86bb0-8706-4145-b888-bd6b718db4b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:50.555611 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-55599a54-f9de-4ece-b223-5d2420e0462c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:56:50.563016 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-55599a54-f9de-4ece-b223-5d2420e0462c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1548 microversion: 2.1 time: 0.162618 Aug 30 07:56:50.563591 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 567/1185] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:56:50 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:50.579786 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-88ee0b4f-f1c9-469f-929b-d1c88623a553 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:56:50.580273 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-88ee0b4f-f1c9-469f-929b-d1c88623a553 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:50.586980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-88ee0b4f-f1c9-469f-929b-d1c88623a553 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:50.587420 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-88ee0b4f-f1c9-469f-929b-d1c88623a553 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:50.588085 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-88ee0b4f-f1c9-469f-929b-d1c88623a553 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:50.589048 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-88ee0b4f-f1c9-469f-929b-d1c88623a553 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:50.607053 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bfb86bb0-8706-4145-b888-bd6b718db4b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 14 microversion: 2.20 time: 0.078843 Aug 30 07:56:50.610482 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 619/1186] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:50 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:56:50.668439 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-88ee0b4f-f1c9-469f-929b-d1c88623a553 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092290 Aug 30 07:56:50.669038 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 568/1187] 10.222.0.73 () {58 vars in 1275 bytes} [Mon Aug 30 07:56:50 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:56:51.619904 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-917bd9d1-2412-4b87-9288-eaf692deb385 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:51.620939 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-917bd9d1-2412-4b87-9288-eaf692deb385 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:51.628168 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-917bd9d1-2412-4b87-9288-eaf692deb385 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:51.628676 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-917bd9d1-2412-4b87-9288-eaf692deb385 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:51.629460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-917bd9d1-2412-4b87-9288-eaf692deb385 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:51.629896 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-917bd9d1-2412-4b87-9288-eaf692deb385 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:51.698827 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-917bd9d1-2412-4b87-9288-eaf692deb385 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 14 microversion: 2.20 time: 0.083442 Aug 30 07:56:51.701940 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 620/1188] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:51 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:56:51.870745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-58fec2b5-6d88-4dfd-ae3e-d0bba51d8357 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:51.871303 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-437ac2c1-e5b7-488b-94d7-404399ccdab7 req-2c2d1763-6f75-49ef-a253-b0b7b306fa5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eb1895f-02c2-4252-a5ba-f3c6496dfa4d", "tag": "fe883039-4227-47ba-89b3-d8497a08c086"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:51.871888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-58fec2b5-6d88-4dfd-ae3e-d0bba51d8357 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:51.872748 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:56:51.872748 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:56:51.878047 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-58fec2b5-6d88-4dfd-ae3e-d0bba51d8357 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:51.878612 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-58fec2b5-6d88-4dfd-ae3e-d0bba51d8357 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:51.879548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-58fec2b5-6d88-4dfd-ae3e-d0bba51d8357 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:51.879994 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-58fec2b5-6d88-4dfd-ae3e-d0bba51d8357 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:51.881081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-437ac2c1-e5b7-488b-94d7-404399ccdab7 req-2c2d1763-6f75-49ef-a253-b0b7b306fa5e service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:51.881614 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-437ac2c1-e5b7-488b-94d7-404399ccdab7 req-2c2d1763-6f75-49ef-a253-b0b7b306fa5e service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:51.894518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-437ac2c1-e5b7-488b-94d7-404399ccdab7 req-2c2d1763-6f75-49ef-a253-b0b7b306fa5e service nova] Creating event network-changed:fe883039-4227-47ba-89b3-d8497a08c086 for instance 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d on hv-cinder-80619 Aug 30 07:56:51.900386 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-437ac2c1-e5b7-488b-94d7-404399ccdab7 req-2c2d1763-6f75-49ef-a253-b0b7b306fa5e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033302 Aug 30 07:56:51.901088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 621/1189] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:56:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:56:51.951497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-58fec2b5-6d88-4dfd-ae3e-d0bba51d8357 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 14 microversion: 2.1 time: 0.087411 Aug 30 07:56:51.952009 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 569/1190] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:56:51 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:56:52.709455 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-da128375-46f2-4c05-9c29-2b296dd6e911 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:52.710518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-da128375-46f2-4c05-9c29-2b296dd6e911 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:52.717673 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-da128375-46f2-4c05-9c29-2b296dd6e911 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:52.718117 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-da128375-46f2-4c05-9c29-2b296dd6e911 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:52.718942 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-da128375-46f2-4c05-9c29-2b296dd6e911 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:52.719378 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-da128375-46f2-4c05-9c29-2b296dd6e911 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:52.778774 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-da128375-46f2-4c05-9c29-2b296dd6e911 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 14 microversion: 2.20 time: 0.073187 Aug 30 07:56:52.782266 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 622/1191] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:52 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:52.963745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c753bb67-0a64-4257-b370-d607923e4964 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:52.964841 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c753bb67-0a64-4257-b370-d607923e4964 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:52.971959 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c753bb67-0a64-4257-b370-d607923e4964 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:52.972451 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c753bb67-0a64-4257-b370-d607923e4964 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:52.973251 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c753bb67-0a64-4257-b370-d607923e4964 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:52.973697 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c753bb67-0a64-4257-b370-d607923e4964 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:53.034982 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c753bb67-0a64-4257-b370-d607923e4964 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 14 microversion: 2.1 time: 0.075892 Aug 30 07:56:53.035798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 570/1192] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:56:52 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:56:53.791585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ca9cbfc0-f319-41fd-bb11-3544233b8251 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:53.792645 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ca9cbfc0-f319-41fd-bb11-3544233b8251 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:53.799266 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ca9cbfc0-f319-41fd-bb11-3544233b8251 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:53.799712 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ca9cbfc0-f319-41fd-bb11-3544233b8251 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:53.800480 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ca9cbfc0-f319-41fd-bb11-3544233b8251 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:53.800914 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ca9cbfc0-f319-41fd-bb11-3544233b8251 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:53.871950 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ca9cbfc0-f319-41fd-bb11-3544233b8251 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 14 microversion: 2.20 time: 0.085176 Aug 30 07:56:53.872584 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 623/1193] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:53 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:54.046997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-486f28e3-c31d-4474-9a43-ec6a6aefd890 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:54.047987 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-486f28e3-c31d-4474-9a43-ec6a6aefd890 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:54.054467 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-486f28e3-c31d-4474-9a43-ec6a6aefd890 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:54.054914 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-486f28e3-c31d-4474-9a43-ec6a6aefd890 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:54.055682 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-486f28e3-c31d-4474-9a43-ec6a6aefd890 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:54.056116 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-486f28e3-c31d-4474-9a43-ec6a6aefd890 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:54.123027 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-486f28e3-c31d-4474-9a43-ec6a6aefd890 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 14 microversion: 2.1 time: 0.079882 Aug 30 07:56:54.123644 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 571/1194] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:56:54 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:56:54.884319 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-716eafb4-566e-493e-90c5-9e9f0d3a0468 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:54.885451 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-716eafb4-566e-493e-90c5-9e9f0d3a0468 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:54.893810 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-716eafb4-566e-493e-90c5-9e9f0d3a0468 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:54.894292 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-716eafb4-566e-493e-90c5-9e9f0d3a0468 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:54.895071 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-716eafb4-566e-493e-90c5-9e9f0d3a0468 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:54.895504 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-716eafb4-566e-493e-90c5-9e9f0d3a0468 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:54.969113 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-716eafb4-566e-493e-90c5-9e9f0d3a0468 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 14 microversion: 2.20 time: 0.089160 Aug 30 07:56:54.969779 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 624/1195] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:54 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:56:55.134765 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2450d556-71fd-4641-9440-19a8fe9b5d9e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:55.135669 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2450d556-71fd-4641-9440-19a8fe9b5d9e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:55.142676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2450d556-71fd-4641-9440-19a8fe9b5d9e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:55.143214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2450d556-71fd-4641-9440-19a8fe9b5d9e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:55.144040 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2450d556-71fd-4641-9440-19a8fe9b5d9e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:55.144560 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2450d556-71fd-4641-9440-19a8fe9b5d9e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:55.211656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2450d556-71fd-4641-9440-19a8fe9b5d9e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 14 microversion: 2.1 time: 0.080878 Aug 30 07:56:55.212284 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 572/1196] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:56:55 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:56:55.981501 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-96c031a6-9e38-4a46-be91-edf7c1c8af0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:55.982621 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-96c031a6-9e38-4a46-be91-edf7c1c8af0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:55.989105 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96c031a6-9e38-4a46-be91-edf7c1c8af0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:55.989550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96c031a6-9e38-4a46-be91-edf7c1c8af0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:55.990364 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96c031a6-9e38-4a46-be91-edf7c1c8af0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:55.990799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-96c031a6-9e38-4a46-be91-edf7c1c8af0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:56.061875 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-96c031a6-9e38-4a46-be91-edf7c1c8af0c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 6451 microversion: 2.20 time: 0.085237 Aug 30 07:56:56.062565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 625/1197] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:55 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 6451 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:56:56.223394 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b073284d-5e08-4385-b531-f6d2ac8c14bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:56.224308 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b073284d-5e08-4385-b531-f6d2ac8c14bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:56.231426 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b073284d-5e08-4385-b531-f6d2ac8c14bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:56.231875 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b073284d-5e08-4385-b531-f6d2ac8c14bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:56.232655 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b073284d-5e08-4385-b531-f6d2ac8c14bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:56.233082 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b073284d-5e08-4385-b531-f6d2ac8c14bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:56.303490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b073284d-5e08-4385-b531-f6d2ac8c14bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 14 microversion: 2.1 time: 0.084212 Aug 30 07:56:56.304089 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 573/1198] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:56:56 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:56:57.073672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2762bcb5-bbef-423b-9c50-20c0d1348396 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:57.074694 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2762bcb5-bbef-423b-9c50-20c0d1348396 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:57.081531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2762bcb5-bbef-423b-9c50-20c0d1348396 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:57.081982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2762bcb5-bbef-423b-9c50-20c0d1348396 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:57.082783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2762bcb5-bbef-423b-9c50-20c0d1348396 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:57.083216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2762bcb5-bbef-423b-9c50-20c0d1348396 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:57.160191 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2762bcb5-bbef-423b-9c50-20c0d1348396 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 15025 microversion: 2.20 time: 0.090590 Aug 30 07:56:57.160817 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 626/1199] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:57 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 15025 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:56:57.315215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d870f721-e301-48f7-a020-d6094dfdb174 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:57.316158 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d870f721-e301-48f7-a020-d6094dfdb174 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:57.323361 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d870f721-e301-48f7-a020-d6094dfdb174 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:57.323807 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d870f721-e301-48f7-a020-d6094dfdb174 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:57.324557 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d870f721-e301-48f7-a020-d6094dfdb174 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:57.324986 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d870f721-e301-48f7-a020-d6094dfdb174 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:57.387022 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d870f721-e301-48f7-a020-d6094dfdb174 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 14 microversion: 2.1 time: 0.075654 Aug 30 07:56:57.387661 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 574/1200] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:56:57 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:56:58.171986 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ae17894b-5f11-42a0-8f89-a0b4a31ef974 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:58.172898 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ae17894b-5f11-42a0-8f89-a0b4a31ef974 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:58.179230 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ae17894b-5f11-42a0-8f89-a0b4a31ef974 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:58.180490 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ae17894b-5f11-42a0-8f89-a0b4a31ef974 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:58.181299 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ae17894b-5f11-42a0-8f89-a0b4a31ef974 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:58.181728 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ae17894b-5f11-42a0-8f89-a0b4a31ef974 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:58.261135 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ae17894b-5f11-42a0-8f89-a0b4a31ef974 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 18449 microversion: 2.20 time: 0.093145 Aug 30 07:56:58.261766 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 627/1201] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:58 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 18449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:56:58.399118 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8e19e959-cb8d-48ba-bc59-bb3b84850511 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:58.400198 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8e19e959-cb8d-48ba-bc59-bb3b84850511 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:58.406715 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e19e959-cb8d-48ba-bc59-bb3b84850511 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:58.407161 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e19e959-cb8d-48ba-bc59-bb3b84850511 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:58.407928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e19e959-cb8d-48ba-bc59-bb3b84850511 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:58.408393 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e19e959-cb8d-48ba-bc59-bb3b84850511 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:58.475591 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8e19e959-cb8d-48ba-bc59-bb3b84850511 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 14 microversion: 2.1 time: 0.080697 Aug 30 07:56:58.476159 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 575/1202] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:56:58 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:56:59.273003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e19a2642-8597-499f-98d0-8fc1f207d437 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:59.274066 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e19a2642-8597-499f-98d0-8fc1f207d437 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:59.280552 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e19a2642-8597-499f-98d0-8fc1f207d437 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:59.281020 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e19a2642-8597-499f-98d0-8fc1f207d437 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:59.281782 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e19a2642-8597-499f-98d0-8fc1f207d437 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:59.282239 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e19a2642-8597-499f-98d0-8fc1f207d437 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:59.358511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e19a2642-8597-499f-98d0-8fc1f207d437 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 19342 microversion: 2.20 time: 0.089444 Aug 30 07:56:59.359156 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 628/1203] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:56:59 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 19342 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:56:59.487797 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-21722cfd-4c28-4a5a-a2d8-481b0c75c5a7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:56:59.488803 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-21722cfd-4c28-4a5a-a2d8-481b0c75c5a7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:56:59.496187 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21722cfd-4c28-4a5a-a2d8-481b0c75c5a7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:59.496651 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21722cfd-4c28-4a5a-a2d8-481b0c75c5a7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:59.497428 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21722cfd-4c28-4a5a-a2d8-481b0c75c5a7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:56:59.497863 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-21722cfd-4c28-4a5a-a2d8-481b0c75c5a7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:56:59.557683 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-21722cfd-4c28-4a5a-a2d8-481b0c75c5a7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 14 microversion: 2.1 time: 0.073666 Aug 30 07:56:59.558252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 576/1204] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:56:59 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:57:00.371152 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b2de18c2-d0aa-497f-be55-e8ea7617daf2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:00.372174 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b2de18c2-d0aa-497f-be55-e8ea7617daf2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:00.378730 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b2de18c2-d0aa-497f-be55-e8ea7617daf2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:00.379183 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b2de18c2-d0aa-497f-be55-e8ea7617daf2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:00.379957 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b2de18c2-d0aa-497f-be55-e8ea7617daf2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:00.380393 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b2de18c2-d0aa-497f-be55-e8ea7617daf2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:00.455126 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b2de18c2-d0aa-497f-be55-e8ea7617daf2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 21972 microversion: 2.20 time: 0.088400 Aug 30 07:57:00.455786 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 629/1205] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:00 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 21972 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:00.569575 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f5ac3353-780a-4732-8761-dce6e8e616d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:00.571342 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f5ac3353-780a-4732-8761-dce6e8e616d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:00.577857 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5ac3353-780a-4732-8761-dce6e8e616d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:00.578337 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5ac3353-780a-4732-8761-dce6e8e616d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:00.579120 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5ac3353-780a-4732-8761-dce6e8e616d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:00.579548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5ac3353-780a-4732-8761-dce6e8e616d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:00.644738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f5ac3353-780a-4732-8761-dce6e8e616d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 14 microversion: 2.1 time: 0.079047 Aug 30 07:57:00.645460 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 577/1206] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:00 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:57:01.468062 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b8fe2665-df46-460f-8220-12a1c36ff0be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:01.469065 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b8fe2665-df46-460f-8220-12a1c36ff0be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:01.475643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8fe2665-df46-460f-8220-12a1c36ff0be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:01.476091 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8fe2665-df46-460f-8220-12a1c36ff0be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:01.477453 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8fe2665-df46-460f-8220-12a1c36ff0be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:01.477885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b8fe2665-df46-460f-8220-12a1c36ff0be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:01.551673 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b8fe2665-df46-460f-8220-12a1c36ff0be tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 23235 microversion: 2.20 time: 0.087535 Aug 30 07:57:01.552314 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 630/1207] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:01 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 23235 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:01.656486 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3e898576-3412-414d-88a5-fb63cdbe337c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:01.657494 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3e898576-3412-414d-88a5-fb63cdbe337c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:01.664484 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3e898576-3412-414d-88a5-fb63cdbe337c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:01.664933 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3e898576-3412-414d-88a5-fb63cdbe337c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:01.665705 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3e898576-3412-414d-88a5-fb63cdbe337c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:01.666194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3e898576-3412-414d-88a5-fb63cdbe337c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:01.728693 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3e898576-3412-414d-88a5-fb63cdbe337c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 14 microversion: 2.1 time: 0.075819 Aug 30 07:57:01.729236 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 578/1208] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:01 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:57:02.564488 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-51240926-5f4b-4c4a-a27d-e400c4c4e28d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:02.565521 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-51240926-5f4b-4c4a-a27d-e400c4c4e28d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:02.572626 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-51240926-5f4b-4c4a-a27d-e400c4c4e28d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:02.573068 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-51240926-5f4b-4c4a-a27d-e400c4c4e28d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:02.573832 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-51240926-5f4b-4c4a-a27d-e400c4c4e28d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:02.574295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-51240926-5f4b-4c4a-a27d-e400c4c4e28d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:02.657662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-51240926-5f4b-4c4a-a27d-e400c4c4e28d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 24448 microversion: 2.20 time: 0.096992 Aug 30 07:57:02.658609 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 631/1209] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:02 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 24448 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:02.739917 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-de3d0d55-7c13-4cb4-a5f0-0ceb3e1ec875 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:02.740907 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-de3d0d55-7c13-4cb4-a5f0-0ceb3e1ec875 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:02.747892 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de3d0d55-7c13-4cb4-a5f0-0ceb3e1ec875 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:02.748340 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de3d0d55-7c13-4cb4-a5f0-0ceb3e1ec875 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:02.749104 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de3d0d55-7c13-4cb4-a5f0-0ceb3e1ec875 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:02.749539 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de3d0d55-7c13-4cb4-a5f0-0ceb3e1ec875 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:02.815766 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-de3d0d55-7c13-4cb4-a5f0-0ceb3e1ec875 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 14 microversion: 2.1 time: 0.079662 Aug 30 07:57:02.816279 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 579/1210] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:02 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:57:03.669983 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e0febe4f-8f70-4fc7-a3ad-b528bb908a3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:03.670995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e0febe4f-8f70-4fc7-a3ad-b528bb908a3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:03.677525 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0febe4f-8f70-4fc7-a3ad-b528bb908a3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:03.677905 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0febe4f-8f70-4fc7-a3ad-b528bb908a3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:03.678688 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0febe4f-8f70-4fc7-a3ad-b528bb908a3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:03.679171 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0febe4f-8f70-4fc7-a3ad-b528bb908a3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:03.749971 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e0febe4f-8f70-4fc7-a3ad-b528bb908a3c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 25837 microversion: 2.20 time: 0.083892 Aug 30 07:57:03.750665 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 632/1211] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:03 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 25837 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:57:03.826524 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-425a233e-6288-46b0-b8f8-bbf9af23ac39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:03.827522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-425a233e-6288-46b0-b8f8-bbf9af23ac39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:03.833945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-425a233e-6288-46b0-b8f8-bbf9af23ac39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:03.834431 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-425a233e-6288-46b0-b8f8-bbf9af23ac39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:03.835194 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-425a233e-6288-46b0-b8f8-bbf9af23ac39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:03.836209 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-425a233e-6288-46b0-b8f8-bbf9af23ac39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:03.903489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-425a233e-6288-46b0-b8f8-bbf9af23ac39 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 6451 microversion: 2.1 time: 0.080857 Aug 30 07:57:03.904099 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 580/1212] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:03 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 6451 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:57:04.762356 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-49e6df5e-a061-482f-8ed5-00fa5635e255 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:04.763364 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-49e6df5e-a061-482f-8ed5-00fa5635e255 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:04.770081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-49e6df5e-a061-482f-8ed5-00fa5635e255 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:04.770550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-49e6df5e-a061-482f-8ed5-00fa5635e255 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:04.771317 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-49e6df5e-a061-482f-8ed5-00fa5635e255 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:04.771749 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-49e6df5e-a061-482f-8ed5-00fa5635e255 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:04.855974 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-49e6df5e-a061-482f-8ed5-00fa5635e255 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 26803 microversion: 2.20 time: 0.097754 Aug 30 07:57:04.856611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 633/1213] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:04 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 26803 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:04.914515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-60c011fe-81d7-4bf5-9325-b048ccbef336 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:04.915528 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-60c011fe-81d7-4bf5-9325-b048ccbef336 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:04.922264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-60c011fe-81d7-4bf5-9325-b048ccbef336 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:04.922716 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-60c011fe-81d7-4bf5-9325-b048ccbef336 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:04.923483 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-60c011fe-81d7-4bf5-9325-b048ccbef336 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:04.923914 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-60c011fe-81d7-4bf5-9325-b048ccbef336 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:04.998388 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-60c011fe-81d7-4bf5-9325-b048ccbef336 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 13887 microversion: 2.1 time: 0.087731 Aug 30 07:57:05.001811 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 581/1214] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:04 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 13887 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:57:05.868465 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c65643f1-e14b-4484-aa5d-20448d44b52a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:05.869468 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c65643f1-e14b-4484-aa5d-20448d44b52a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:05.875944 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c65643f1-e14b-4484-aa5d-20448d44b52a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:05.876390 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c65643f1-e14b-4484-aa5d-20448d44b52a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:05.877153 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c65643f1-e14b-4484-aa5d-20448d44b52a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:05.877585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c65643f1-e14b-4484-aa5d-20448d44b52a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:05.956102 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c65643f1-e14b-4484-aa5d-20448d44b52a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 27344 microversion: 2.20 time: 0.091542 Aug 30 07:57:05.956751 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 634/1215] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:05 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 27344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:06.010523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-24e6ec5c-2558-466b-afab-f2a824732ffb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:06.011513 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-24e6ec5c-2558-466b-afab-f2a824732ffb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:06.017852 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-24e6ec5c-2558-466b-afab-f2a824732ffb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:06.018329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-24e6ec5c-2558-466b-afab-f2a824732ffb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:06.019084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-24e6ec5c-2558-466b-afab-f2a824732ffb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:06.019515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-24e6ec5c-2558-466b-afab-f2a824732ffb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:06.090313 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-24e6ec5c-2558-466b-afab-f2a824732ffb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 18155 microversion: 2.1 time: 0.083553 Aug 30 07:57:06.091019 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 582/1216] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:06 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 18155 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:06.968245 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-656704dd-dcb0-448d-b176-9c92584ae701 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:06.969260 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-656704dd-dcb0-448d-b176-9c92584ae701 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:06.975727 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-656704dd-dcb0-448d-b176-9c92584ae701 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:06.976212 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-656704dd-dcb0-448d-b176-9c92584ae701 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:06.977509 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-656704dd-dcb0-448d-b176-9c92584ae701 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:06.977938 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-656704dd-dcb0-448d-b176-9c92584ae701 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:07.083554 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-656704dd-dcb0-448d-b176-9c92584ae701 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 27621 microversion: 2.20 time: 0.119311 Aug 30 07:57:07.084189 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 635/1217] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:06 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 27621 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:07.101093 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4b2a9ca3-b4b2-4b0c-9b33-393e4488a256 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:07.102792 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4b2a9ca3-b4b2-4b0c-9b33-393e4488a256 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:07.109352 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4b2a9ca3-b4b2-4b0c-9b33-393e4488a256 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:07.109794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4b2a9ca3-b4b2-4b0c-9b33-393e4488a256 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:07.110576 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4b2a9ca3-b4b2-4b0c-9b33-393e4488a256 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:07.111034 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4b2a9ca3-b4b2-4b0c-9b33-393e4488a256 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:07.196489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4b2a9ca3-b4b2-4b0c-9b33-393e4488a256 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 19342 microversion: 2.1 time: 0.099158 Aug 30 07:57:07.197149 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 583/1218] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:07 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 19342 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:08.095703 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7ce81479-e391-4ee6-a148-7f0c54bce51c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:08.096736 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7ce81479-e391-4ee6-a148-7f0c54bce51c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:08.103473 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7ce81479-e391-4ee6-a148-7f0c54bce51c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:08.103919 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7ce81479-e391-4ee6-a148-7f0c54bce51c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:08.104673 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7ce81479-e391-4ee6-a148-7f0c54bce51c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:08.105102 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7ce81479-e391-4ee6-a148-7f0c54bce51c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:08.205034 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7ce81479-e391-4ee6-a148-7f0c54bce51c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 27871 microversion: 2.20 time: 0.113173 Aug 30 07:57:08.209233 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 636/1219] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:08 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 27871 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:08.209709 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-25cba7c2-6719-427e-a9af-5744a4ab01af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:08.210739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-25cba7c2-6719-427e-a9af-5744a4ab01af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:08.217568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-25cba7c2-6719-427e-a9af-5744a4ab01af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:08.217948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-25cba7c2-6719-427e-a9af-5744a4ab01af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:08.218756 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-25cba7c2-6719-427e-a9af-5744a4ab01af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:08.219188 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-25cba7c2-6719-427e-a9af-5744a4ab01af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:08.313788 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-25cba7c2-6719-427e-a9af-5744a4ab01af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 20991 microversion: 2.1 time: 0.108856 Aug 30 07:57:08.314489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 584/1220] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:08 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 20991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:57:09.218038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-588336d1-2b1d-4a63-bab5-f49c00618e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:09.218987 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-588336d1-2b1d-4a63-bab5-f49c00618e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:09.225388 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-588336d1-2b1d-4a63-bab5-f49c00618e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:09.225829 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-588336d1-2b1d-4a63-bab5-f49c00618e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:09.226613 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-588336d1-2b1d-4a63-bab5-f49c00618e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:09.227046 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-588336d1-2b1d-4a63-bab5-f49c00618e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:09.310795 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-588336d1-2b1d-4a63-bab5-f49c00618e5e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28050 microversion: 2.20 time: 0.096730 Aug 30 07:57:09.311436 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 637/1221] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:09 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28050 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:09.325745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e0839524-16a4-4500-bf1f-d57334d518f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:09.326767 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e0839524-16a4-4500-bf1f-d57334d518f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:09.333270 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e0839524-16a4-4500-bf1f-d57334d518f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:09.333747 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e0839524-16a4-4500-bf1f-d57334d518f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:09.334588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e0839524-16a4-4500-bf1f-d57334d518f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:09.335067 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e0839524-16a4-4500-bf1f-d57334d518f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:09.418501 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e0839524-16a4-4500-bf1f-d57334d518f6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 22803 microversion: 2.1 time: 0.097131 Aug 30 07:57:09.419403 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 585/1222] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:09 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 22803 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:57:10.323263 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ddebcda1-ab9c-4d94-938f-8c31cb12fd5a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:10.324186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ddebcda1-ab9c-4d94-938f-8c31cb12fd5a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:10.330609 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ddebcda1-ab9c-4d94-938f-8c31cb12fd5a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:10.331058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ddebcda1-ab9c-4d94-938f-8c31cb12fd5a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:10.331821 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ddebcda1-ab9c-4d94-938f-8c31cb12fd5a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:10.332258 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ddebcda1-ab9c-4d94-938f-8c31cb12fd5a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:10.427363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ddebcda1-ab9c-4d94-938f-8c31cb12fd5a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.108199 Aug 30 07:57:10.428201 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 638/1223] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:10 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:10.429647 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-99c296cc-44d5-489a-9167-50107d4d1830 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:10.430698 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-99c296cc-44d5-489a-9167-50107d4d1830 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:10.437286 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-99c296cc-44d5-489a-9167-50107d4d1830 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:10.437731 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-99c296cc-44d5-489a-9167-50107d4d1830 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:10.438537 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-99c296cc-44d5-489a-9167-50107d4d1830 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:10.438960 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-99c296cc-44d5-489a-9167-50107d4d1830 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:10.535363 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-99c296cc-44d5-489a-9167-50107d4d1830 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 23797 microversion: 2.1 time: 0.109653 Aug 30 07:57:10.536010 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 586/1224] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:10 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 23797 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:57:11.439431 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3c263ab3-9327-47ba-8fcf-05182eb980a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:11.440439 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3c263ab3-9327-47ba-8fcf-05182eb980a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:11.447034 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3c263ab3-9327-47ba-8fcf-05182eb980a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:11.447481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3c263ab3-9327-47ba-8fcf-05182eb980a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:11.448242 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3c263ab3-9327-47ba-8fcf-05182eb980a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:11.448672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3c263ab3-9327-47ba-8fcf-05182eb980a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:11.527883 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3c263ab3-9327-47ba-8fcf-05182eb980a5 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.092421 Aug 30 07:57:11.529164 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 639/1225] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:11 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:11.547121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-18f0b7cf-aa31-41fe-8915-3686778ef69a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:11.548165 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-18f0b7cf-aa31-41fe-8915-3686778ef69a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:11.554711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18f0b7cf-aa31-41fe-8915-3686778ef69a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:11.555158 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18f0b7cf-aa31-41fe-8915-3686778ef69a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:11.555968 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18f0b7cf-aa31-41fe-8915-3686778ef69a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:11.556405 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18f0b7cf-aa31-41fe-8915-3686778ef69a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:11.654224 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-18f0b7cf-aa31-41fe-8915-3686778ef69a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 24521 microversion: 2.1 time: 0.111223 Aug 30 07:57:11.654875 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 587/1226] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:11 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 24521 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:12.540526 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fb630403-44b5-4931-a695-11f7d5c7219a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:12.541517 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fb630403-44b5-4931-a695-11f7d5c7219a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:12.547948 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fb630403-44b5-4931-a695-11f7d5c7219a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:12.548389 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fb630403-44b5-4931-a695-11f7d5c7219a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:12.549136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fb630403-44b5-4931-a695-11f7d5c7219a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:12.549568 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fb630403-44b5-4931-a695-11f7d5c7219a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:12.631696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fb630403-44b5-4931-a695-11f7d5c7219a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.095122 Aug 30 07:57:12.635530 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 640/1227] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:12 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:12.665860 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f36d5c13-96c9-4b34-9741-93114e88af81 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:12.666910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f36d5c13-96c9-4b34-9741-93114e88af81 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:12.673955 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f36d5c13-96c9-4b34-9741-93114e88af81 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:12.674435 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f36d5c13-96c9-4b34-9741-93114e88af81 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:12.675209 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f36d5c13-96c9-4b34-9741-93114e88af81 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:12.675641 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f36d5c13-96c9-4b34-9741-93114e88af81 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:12.786562 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f36d5c13-96c9-4b34-9741-93114e88af81 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 25662 microversion: 2.1 time: 0.124520 Aug 30 07:57:12.787203 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 588/1228] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:12 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 25662 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:13.643394 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-05757764-a347-4412-a0f3-dde7a96c9b69 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:13.644401 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-05757764-a347-4412-a0f3-dde7a96c9b69 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:13.650919 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-05757764-a347-4412-a0f3-dde7a96c9b69 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:13.651361 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-05757764-a347-4412-a0f3-dde7a96c9b69 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:13.652123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-05757764-a347-4412-a0f3-dde7a96c9b69 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:13.652554 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-05757764-a347-4412-a0f3-dde7a96c9b69 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:13.722853 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-05757764-a347-4412-a0f3-dde7a96c9b69 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.083453 Aug 30 07:57:13.723630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 641/1229] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:13 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:13.799336 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-becfe334-eac4-4ea5-97c9-fff3936a831b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:13.800332 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-becfe334-eac4-4ea5-97c9-fff3936a831b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:13.806781 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-becfe334-eac4-4ea5-97c9-fff3936a831b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:13.807228 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-becfe334-eac4-4ea5-97c9-fff3936a831b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:13.807991 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-becfe334-eac4-4ea5-97c9-fff3936a831b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:13.808423 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-becfe334-eac4-4ea5-97c9-fff3936a831b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:13.896846 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-becfe334-eac4-4ea5-97c9-fff3936a831b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 26567 microversion: 2.1 time: 0.101778 Aug 30 07:57:13.897497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 589/1230] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:13 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 26567 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:14.735309 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9baed348-1e8e-4ec4-ad98-6dc2534c6c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:14.736301 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9baed348-1e8e-4ec4-ad98-6dc2534c6c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:14.742733 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9baed348-1e8e-4ec4-ad98-6dc2534c6c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:14.743172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9baed348-1e8e-4ec4-ad98-6dc2534c6c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:14.743938 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9baed348-1e8e-4ec4-ad98-6dc2534c6c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:14.744365 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9baed348-1e8e-4ec4-ad98-6dc2534c6c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:14.825298 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9baed348-1e8e-4ec4-ad98-6dc2534c6c19 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.094136 Aug 30 07:57:14.825957 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 642/1231] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:14 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:14.909275 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-eb0a8bda-1abd-4afe-950b-b64e84a4b29f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:14.910288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-eb0a8bda-1abd-4afe-950b-b64e84a4b29f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:14.916785 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb0a8bda-1abd-4afe-950b-b64e84a4b29f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:14.917264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb0a8bda-1abd-4afe-950b-b64e84a4b29f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:14.917994 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb0a8bda-1abd-4afe-950b-b64e84a4b29f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:14.918446 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eb0a8bda-1abd-4afe-950b-b64e84a4b29f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:15.025423 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-eb0a8bda-1abd-4afe-950b-b64e84a4b29f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 27511 microversion: 2.1 time: 0.119917 Aug 30 07:57:15.025993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 590/1232] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:14 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 27511 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:15.837482 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0ef0cb3d-a8af-4a68-81e8-acc3b6dda102 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:15.838404 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0ef0cb3d-a8af-4a68-81e8-acc3b6dda102 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:15.845520 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0ef0cb3d-a8af-4a68-81e8-acc3b6dda102 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:15.845961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0ef0cb3d-a8af-4a68-81e8-acc3b6dda102 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:15.846800 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0ef0cb3d-a8af-4a68-81e8-acc3b6dda102 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:15.847184 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0ef0cb3d-a8af-4a68-81e8-acc3b6dda102 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:15.920468 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0ef0cb3d-a8af-4a68-81e8-acc3b6dda102 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.087006 Aug 30 07:57:15.921537 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 643/1233] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:15 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:57:16.038584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4f2ec760-f6eb-41e7-af2f-010f474d0ddf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:16.039571 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4f2ec760-f6eb-41e7-af2f-010f474d0ddf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:16.046000 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f2ec760-f6eb-41e7-af2f-010f474d0ddf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:16.046511 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f2ec760-f6eb-41e7-af2f-010f474d0ddf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:16.047323 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f2ec760-f6eb-41e7-af2f-010f474d0ddf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:16.047750 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f2ec760-f6eb-41e7-af2f-010f474d0ddf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:16.141023 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4f2ec760-f6eb-41e7-af2f-010f474d0ddf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 27876 microversion: 2.1 time: 0.105634 Aug 30 07:57:16.141637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 591/1234] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:16 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 27876 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:16.932714 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-255fa629-dc2b-4c36-9993-7d02d2c9ca52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:16.933747 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-255fa629-dc2b-4c36-9993-7d02d2c9ca52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:16.940672 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-255fa629-dc2b-4c36-9993-7d02d2c9ca52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:16.941119 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-255fa629-dc2b-4c36-9993-7d02d2c9ca52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:16.941882 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-255fa629-dc2b-4c36-9993-7d02d2c9ca52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:16.942357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-255fa629-dc2b-4c36-9993-7d02d2c9ca52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:17.032799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-255fa629-dc2b-4c36-9993-7d02d2c9ca52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.104000 Aug 30 07:57:17.033440 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 644/1235] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:16 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:17.153071 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d7579057-b7ba-4b77-8f88-e8774781b4fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:17.154087 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d7579057-b7ba-4b77-8f88-e8774781b4fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:17.160302 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d7579057-b7ba-4b77-8f88-e8774781b4fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:17.160743 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d7579057-b7ba-4b77-8f88-e8774781b4fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:17.161496 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d7579057-b7ba-4b77-8f88-e8774781b4fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:17.161924 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d7579057-b7ba-4b77-8f88-e8774781b4fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:17.287450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d7579057-b7ba-4b77-8f88-e8774781b4fa tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28173 microversion: 2.1 time: 0.138176 Aug 30 07:57:17.288267 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 592/1236] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:17 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28173 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:18.044456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c47b5abd-cbd7-48da-bc22-b0f695f0f5f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:18.045477 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c47b5abd-cbd7-48da-bc22-b0f695f0f5f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:18.052014 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c47b5abd-cbd7-48da-bc22-b0f695f0f5f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:18.052461 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c47b5abd-cbd7-48da-bc22-b0f695f0f5f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:18.053212 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c47b5abd-cbd7-48da-bc22-b0f695f0f5f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:18.053634 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c47b5abd-cbd7-48da-bc22-b0f695f0f5f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:18.126669 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c47b5abd-cbd7-48da-bc22-b0f695f0f5f9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.086153 Aug 30 07:57:18.127281 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 645/1237] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:18 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:18.299755 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0d2e0bda-5696-4d56-bbce-02d36da4ee88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:18.300727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0d2e0bda-5696-4d56-bbce-02d36da4ee88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:18.307552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0d2e0bda-5696-4d56-bbce-02d36da4ee88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:18.308005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0d2e0bda-5696-4d56-bbce-02d36da4ee88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:18.308779 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0d2e0bda-5696-4d56-bbce-02d36da4ee88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:18.309223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0d2e0bda-5696-4d56-bbce-02d36da4ee88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:18.404407 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0d2e0bda-5696-4d56-bbce-02d36da4ee88 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.108929 Aug 30 07:57:18.405072 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 593/1238] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:18 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:19.138701 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-68be7b47-7fb0-46f3-8db8-190dc4e25467 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:19.139697 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-68be7b47-7fb0-46f3-8db8-190dc4e25467 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:19.146684 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-68be7b47-7fb0-46f3-8db8-190dc4e25467 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:19.147128 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-68be7b47-7fb0-46f3-8db8-190dc4e25467 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:19.147884 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-68be7b47-7fb0-46f3-8db8-190dc4e25467 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:19.148309 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-68be7b47-7fb0-46f3-8db8-190dc4e25467 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:19.212330 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-68be7b47-7fb0-46f3-8db8-190dc4e25467 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.077549 Aug 30 07:57:19.212943 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 646/1239] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:19 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:19.416712 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3a56784a-3c5a-49ae-8f29-a81fd62033c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:19.417713 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3a56784a-3c5a-49ae-8f29-a81fd62033c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:19.425017 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3a56784a-3c5a-49ae-8f29-a81fd62033c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:19.425464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3a56784a-3c5a-49ae-8f29-a81fd62033c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:19.426264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3a56784a-3c5a-49ae-8f29-a81fd62033c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:19.426697 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3a56784a-3c5a-49ae-8f29-a81fd62033c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:19.489839 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3a56784a-3c5a-49ae-8f29-a81fd62033c0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.077013 Aug 30 07:57:19.490503 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 594/1240] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:19 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:20.224852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e80ffa86-7700-4028-8374-20c14587d377 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:20.225762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e80ffa86-7700-4028-8374-20c14587d377 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:20.232460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e80ffa86-7700-4028-8374-20c14587d377 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:20.232897 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e80ffa86-7700-4028-8374-20c14587d377 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:20.234417 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e80ffa86-7700-4028-8374-20c14587d377 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:20.234983 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e80ffa86-7700-4028-8374-20c14587d377 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:20.295495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e80ffa86-7700-4028-8374-20c14587d377 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.074676 Aug 30 07:57:20.296704 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 647/1241] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:20 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:20.502622 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7fa5ad9f-b648-43f1-9f6e-08392cbc0581 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:20.503536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7fa5ad9f-b648-43f1-9f6e-08392cbc0581 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:20.510009 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7fa5ad9f-b648-43f1-9f6e-08392cbc0581 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:20.510494 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7fa5ad9f-b648-43f1-9f6e-08392cbc0581 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:20.511259 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7fa5ad9f-b648-43f1-9f6e-08392cbc0581 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:20.511697 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7fa5ad9f-b648-43f1-9f6e-08392cbc0581 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:20.579716 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7fa5ad9f-b648-43f1-9f6e-08392cbc0581 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.081725 Aug 30 07:57:20.580337 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 595/1242] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:20 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:21.308367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-21a273e4-e9a0-4efd-ad63-e162d47cd7cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:21.309270 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-21a273e4-e9a0-4efd-ad63-e162d47cd7cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:21.315709 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21a273e4-e9a0-4efd-ad63-e162d47cd7cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:21.316158 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21a273e4-e9a0-4efd-ad63-e162d47cd7cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:21.316908 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21a273e4-e9a0-4efd-ad63-e162d47cd7cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:21.317338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21a273e4-e9a0-4efd-ad63-e162d47cd7cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:21.393189 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-21a273e4-e9a0-4efd-ad63-e162d47cd7cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.088915 Aug 30 07:57:21.393807 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 648/1243] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:21 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:57:21.591834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b5b9dfa7-955d-46ec-8aea-8d9e29302ee5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:21.593421 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b5b9dfa7-955d-46ec-8aea-8d9e29302ee5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:21.600030 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b5b9dfa7-955d-46ec-8aea-8d9e29302ee5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:21.600464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b5b9dfa7-955d-46ec-8aea-8d9e29302ee5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:21.601232 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b5b9dfa7-955d-46ec-8aea-8d9e29302ee5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:21.601665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b5b9dfa7-955d-46ec-8aea-8d9e29302ee5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:21.675529 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b5b9dfa7-955d-46ec-8aea-8d9e29302ee5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.087531 Aug 30 07:57:21.676482 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 596/1244] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:21 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:22.405816 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-51ea8c8e-093a-4a8d-ab28-dee9dae2edab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:22.406845 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-51ea8c8e-093a-4a8d-ab28-dee9dae2edab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:22.413408 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-51ea8c8e-093a-4a8d-ab28-dee9dae2edab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:22.413852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-51ea8c8e-093a-4a8d-ab28-dee9dae2edab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:22.414646 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-51ea8c8e-093a-4a8d-ab28-dee9dae2edab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:22.415078 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-51ea8c8e-093a-4a8d-ab28-dee9dae2edab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:22.481338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-51ea8c8e-093a-4a8d-ab28-dee9dae2edab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.079608 Aug 30 07:57:22.481949 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 649/1245] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:22 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:22.689394 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9b8b0484-a3bd-4428-904d-e478ac913c57 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:22.690319 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9b8b0484-a3bd-4428-904d-e478ac913c57 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:22.696746 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b8b0484-a3bd-4428-904d-e478ac913c57 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:22.697187 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b8b0484-a3bd-4428-904d-e478ac913c57 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:22.697944 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b8b0484-a3bd-4428-904d-e478ac913c57 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:22.698401 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9b8b0484-a3bd-4428-904d-e478ac913c57 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:22.760352 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9b8b0484-a3bd-4428-904d-e478ac913c57 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.076070 Aug 30 07:57:22.761009 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 597/1246] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:22 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:23.493976 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2d1af472-c1c2-4d37-94d1-2be40d7f5b30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:23.495002 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2d1af472-c1c2-4d37-94d1-2be40d7f5b30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:23.502357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2d1af472-c1c2-4d37-94d1-2be40d7f5b30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:23.502805 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2d1af472-c1c2-4d37-94d1-2be40d7f5b30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:23.503565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2d1af472-c1c2-4d37-94d1-2be40d7f5b30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:23.503995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2d1af472-c1c2-4d37-94d1-2be40d7f5b30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:23.563946 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2d1af472-c1c2-4d37-94d1-2be40d7f5b30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.073961 Aug 30 07:57:23.564806 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 650/1247] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:23 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:23.772408 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5d0e0f0c-2d83-4e5a-be43-b9c3ffae37e5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:23.773403 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5d0e0f0c-2d83-4e5a-be43-b9c3ffae37e5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:23.779794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5d0e0f0c-2d83-4e5a-be43-b9c3ffae37e5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:23.780416 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5d0e0f0c-2d83-4e5a-be43-b9c3ffae37e5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:23.781426 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5d0e0f0c-2d83-4e5a-be43-b9c3ffae37e5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:23.781864 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5d0e0f0c-2d83-4e5a-be43-b9c3ffae37e5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:23.843932 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5d0e0f0c-2d83-4e5a-be43-b9c3ffae37e5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.075451 Aug 30 07:57:23.844561 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 598/1248] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:23 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:24.576167 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-09dc5d13-0b3f-49f7-999e-dadeda680556 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:24.579783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-09dc5d13-0b3f-49f7-999e-dadeda680556 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:24.586120 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-09dc5d13-0b3f-49f7-999e-dadeda680556 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:24.586590 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-09dc5d13-0b3f-49f7-999e-dadeda680556 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:24.587340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-09dc5d13-0b3f-49f7-999e-dadeda680556 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:24.587770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-09dc5d13-0b3f-49f7-999e-dadeda680556 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:24.650700 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-09dc5d13-0b3f-49f7-999e-dadeda680556 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28167 microversion: 2.20 time: 0.078368 Aug 30 07:57:24.651368 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 651/1249] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:24 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28167 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:24.856210 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6658b2ee-0de4-4bbb-9d6c-46183c45723c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:24.857201 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6658b2ee-0de4-4bbb-9d6c-46183c45723c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:24.864567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6658b2ee-0de4-4bbb-9d6c-46183c45723c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:24.865018 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6658b2ee-0de4-4bbb-9d6c-46183c45723c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:24.865777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6658b2ee-0de4-4bbb-9d6c-46183c45723c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:24.866252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6658b2ee-0de4-4bbb-9d6c-46183c45723c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:24.925949 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6658b2ee-0de4-4bbb-9d6c-46183c45723c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.073840 Aug 30 07:57:24.926630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 599/1250] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:24 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:25.662777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ce0bf887-2a70-4de5-9802-df8ac40af82e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:25.663823 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ce0bf887-2a70-4de5-9802-df8ac40af82e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:25.670215 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce0bf887-2a70-4de5-9802-df8ac40af82e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:25.671551 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce0bf887-2a70-4de5-9802-df8ac40af82e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:25.672162 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce0bf887-2a70-4de5-9802-df8ac40af82e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:25.672588 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce0bf887-2a70-4de5-9802-df8ac40af82e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:25.750930 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ce0bf887-2a70-4de5-9802-df8ac40af82e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28295 microversion: 2.20 time: 0.091914 Aug 30 07:57:25.751487 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 652/1251] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:25 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:25.937410 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-73d6e389-3a02-45b1-b958-a547749afe82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:25.938495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-73d6e389-3a02-45b1-b958-a547749afe82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:25.945408 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73d6e389-3a02-45b1-b958-a547749afe82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:25.945860 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73d6e389-3a02-45b1-b958-a547749afe82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:25.946687 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73d6e389-3a02-45b1-b958-a547749afe82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:25.947127 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-73d6e389-3a02-45b1-b958-a547749afe82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:26.025302 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-73d6e389-3a02-45b1-b958-a547749afe82 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.091821 Aug 30 07:57:26.025875 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 600/1252] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:25 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:57:26.762349 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5a7decf7-f6c8-4979-8deb-b8497b17bc6d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:26.763349 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5a7decf7-f6c8-4979-8deb-b8497b17bc6d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:26.770481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a7decf7-f6c8-4979-8deb-b8497b17bc6d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:26.770931 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a7decf7-f6c8-4979-8deb-b8497b17bc6d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:26.771690 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a7decf7-f6c8-4979-8deb-b8497b17bc6d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:26.772123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a7decf7-f6c8-4979-8deb-b8497b17bc6d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:26.848257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5a7decf7-f6c8-4979-8deb-b8497b17bc6d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28458 microversion: 2.20 time: 0.089922 Aug 30 07:57:26.848877 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 653/1253] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:26 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28458 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:27.037421 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b1e9de60-6aa3-4089-b0f8-d9b3bb47bd0e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:27.038371 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b1e9de60-6aa3-4089-b0f8-d9b3bb47bd0e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:27.044834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b1e9de60-6aa3-4089-b0f8-d9b3bb47bd0e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:27.045278 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b1e9de60-6aa3-4089-b0f8-d9b3bb47bd0e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:27.047152 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b1e9de60-6aa3-4089-b0f8-d9b3bb47bd0e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:27.047771 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b1e9de60-6aa3-4089-b0f8-d9b3bb47bd0e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:27.115212 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b1e9de60-6aa3-4089-b0f8-d9b3bb47bd0e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.081717 Aug 30 07:57:27.115831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 601/1254] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:27 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:27.860745 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1f433ad1-c853-4b70-bc0e-fc13316a8c55 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:27.861737 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1f433ad1-c853-4b70-bc0e-fc13316a8c55 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:27.868106 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1f433ad1-c853-4b70-bc0e-fc13316a8c55 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:27.868544 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1f433ad1-c853-4b70-bc0e-fc13316a8c55 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:27.869302 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1f433ad1-c853-4b70-bc0e-fc13316a8c55 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:27.869731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1f433ad1-c853-4b70-bc0e-fc13316a8c55 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:27.948000 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1f433ad1-c853-4b70-bc0e-fc13316a8c55 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.091290 Aug 30 07:57:27.948646 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 654/1255] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:27 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:28.127888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2138a566-9446-4a03-b422-c92005458eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:28.128798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2138a566-9446-4a03-b422-c92005458eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:28.135417 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2138a566-9446-4a03-b422-c92005458eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:28.135864 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2138a566-9446-4a03-b422-c92005458eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:28.136630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2138a566-9446-4a03-b422-c92005458eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:28.137064 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2138a566-9446-4a03-b422-c92005458eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:28.210829 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2138a566-9446-4a03-b422-c92005458eef tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.087471 Aug 30 07:57:28.211735 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 602/1256] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:28 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:28.960494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ae78fe47-b91c-40e7-a278-396cf6e77248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:28.961505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ae78fe47-b91c-40e7-a278-396cf6e77248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:28.968642 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ae78fe47-b91c-40e7-a278-396cf6e77248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:28.969088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ae78fe47-b91c-40e7-a278-396cf6e77248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:28.969865 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ae78fe47-b91c-40e7-a278-396cf6e77248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:28.970331 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ae78fe47-b91c-40e7-a278-396cf6e77248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:29.040484 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ae78fe47-b91c-40e7-a278-396cf6e77248 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.083972 Aug 30 07:57:29.041123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 655/1257] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:28 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:57:29.223655 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-51d8c6b7-c741-4619-91a7-3d865b5eea12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:29.224571 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-51d8c6b7-c741-4619-91a7-3d865b5eea12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:29.231228 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-51d8c6b7-c741-4619-91a7-3d865b5eea12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:29.231674 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-51d8c6b7-c741-4619-91a7-3d865b5eea12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:29.232434 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-51d8c6b7-c741-4619-91a7-3d865b5eea12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:29.232923 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-51d8c6b7-c741-4619-91a7-3d865b5eea12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:29.293615 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-51d8c6b7-c741-4619-91a7-3d865b5eea12 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.074014 Aug 30 07:57:29.294288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 603/1258] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:29 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:57:30.054594 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f292c848-640e-491c-b426-9de4ccaaa5d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:30.055605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f292c848-640e-491c-b426-9de4ccaaa5d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:30.063004 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f292c848-640e-491c-b426-9de4ccaaa5d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:30.063452 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f292c848-640e-491c-b426-9de4ccaaa5d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:30.064232 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f292c848-640e-491c-b426-9de4ccaaa5d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:30.064665 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f292c848-640e-491c-b426-9de4ccaaa5d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:30.128506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f292c848-640e-491c-b426-9de4ccaaa5d3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.077935 Aug 30 07:57:30.129161 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 656/1259] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:30 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:30.306732 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-58f676bd-6ae0-4ebc-a3d8-4a754e8b210b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:30.307633 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-58f676bd-6ae0-4ebc-a3d8-4a754e8b210b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:30.314397 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-58f676bd-6ae0-4ebc-a3d8-4a754e8b210b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:30.314838 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-58f676bd-6ae0-4ebc-a3d8-4a754e8b210b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:30.315597 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-58f676bd-6ae0-4ebc-a3d8-4a754e8b210b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:30.316132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-58f676bd-6ae0-4ebc-a3d8-4a754e8b210b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:30.400653 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-58f676bd-6ae0-4ebc-a3d8-4a754e8b210b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.098040 Aug 30 07:57:30.401289 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 604/1260] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:30 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:31.141494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8252d3c4-faf7-4210-ab83-2f6f8fffbd12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:31.142464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8252d3c4-faf7-4210-ab83-2f6f8fffbd12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:31.149163 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8252d3c4-faf7-4210-ab83-2f6f8fffbd12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:31.149624 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8252d3c4-faf7-4210-ab83-2f6f8fffbd12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:31.150406 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8252d3c4-faf7-4210-ab83-2f6f8fffbd12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:31.150830 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8252d3c4-faf7-4210-ab83-2f6f8fffbd12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:31.210852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8252d3c4-faf7-4210-ab83-2f6f8fffbd12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.073951 Aug 30 07:57:31.211459 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 657/1261] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:31 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:31.412690 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f7186f16-eb00-49aa-9ab0-74342e15c53b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:31.413707 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f7186f16-eb00-49aa-9ab0-74342e15c53b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:31.420787 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f7186f16-eb00-49aa-9ab0-74342e15c53b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:31.421240 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f7186f16-eb00-49aa-9ab0-74342e15c53b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:31.421995 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f7186f16-eb00-49aa-9ab0-74342e15c53b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:31.422452 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f7186f16-eb00-49aa-9ab0-74342e15c53b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:31.492033 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f7186f16-eb00-49aa-9ab0-74342e15c53b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.083223 Aug 30 07:57:31.492665 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 605/1262] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:31 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:32.223720 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4239ad35-df39-48d6-bcb5-5e560fa6a3d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:32.224633 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4239ad35-df39-48d6-bcb5-5e560fa6a3d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:32.231275 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4239ad35-df39-48d6-bcb5-5e560fa6a3d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:32.231726 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4239ad35-df39-48d6-bcb5-5e560fa6a3d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:32.232486 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4239ad35-df39-48d6-bcb5-5e560fa6a3d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:32.233173 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4239ad35-df39-48d6-bcb5-5e560fa6a3d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:32.297596 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4239ad35-df39-48d6-bcb5-5e560fa6a3d8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.077917 Aug 30 07:57:32.298290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 658/1263] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:32 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:32.504360 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0ed7c24e-ffdd-41fe-8be3-28d473213e5b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:32.505290 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0ed7c24e-ffdd-41fe-8be3-28d473213e5b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:32.511676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ed7c24e-ffdd-41fe-8be3-28d473213e5b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:32.512118 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ed7c24e-ffdd-41fe-8be3-28d473213e5b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:32.512883 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ed7c24e-ffdd-41fe-8be3-28d473213e5b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:32.513294 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0ed7c24e-ffdd-41fe-8be3-28d473213e5b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:32.580980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0ed7c24e-ffdd-41fe-8be3-28d473213e5b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.080592 Aug 30 07:57:32.581594 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 606/1264] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:32 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:33.309864 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cc8beb98-862b-406e-9785-18b44c4d23e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:33.310836 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cc8beb98-862b-406e-9785-18b44c4d23e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:33.317292 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc8beb98-862b-406e-9785-18b44c4d23e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:33.317726 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc8beb98-862b-406e-9785-18b44c4d23e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:33.318516 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc8beb98-862b-406e-9785-18b44c4d23e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:33.318943 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc8beb98-862b-406e-9785-18b44c4d23e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:33.382715 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cc8beb98-862b-406e-9785-18b44c4d23e3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.076829 Aug 30 07:57:33.383333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 659/1265] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:33 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:33.593504 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5958a7e6-63dc-40b2-8d56-2886b1d71dcb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:33.594549 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5958a7e6-63dc-40b2-8d56-2886b1d71dcb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:33.600968 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5958a7e6-63dc-40b2-8d56-2886b1d71dcb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:33.601663 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5958a7e6-63dc-40b2-8d56-2886b1d71dcb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:33.602445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5958a7e6-63dc-40b2-8d56-2886b1d71dcb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:33.602970 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5958a7e6-63dc-40b2-8d56-2886b1d71dcb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:33.663738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5958a7e6-63dc-40b2-8d56-2886b1d71dcb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28290 microversion: 2.1 time: 0.074602 Aug 30 07:57:33.664755 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 607/1266] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:33 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28290 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:34.395377 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f5d69bc3-383f-4726-8f5b-53b473b667f2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:34.396408 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f5d69bc3-383f-4726-8f5b-53b473b667f2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:34.402788 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f5d69bc3-383f-4726-8f5b-53b473b667f2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:34.403227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f5d69bc3-383f-4726-8f5b-53b473b667f2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:34.403982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f5d69bc3-383f-4726-8f5b-53b473b667f2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:34.404404 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f5d69bc3-383f-4726-8f5b-53b473b667f2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:34.466898 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f5d69bc3-383f-4726-8f5b-53b473b667f2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.075471 Aug 30 07:57:34.467511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 660/1267] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:34 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:34.676468 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8fb51f07-7b92-4f6c-b465-dd76db9b81e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:34.677474 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8fb51f07-7b92-4f6c-b465-dd76db9b81e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:34.683882 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8fb51f07-7b92-4f6c-b465-dd76db9b81e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:34.684330 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8fb51f07-7b92-4f6c-b465-dd76db9b81e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:34.685090 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8fb51f07-7b92-4f6c-b465-dd76db9b81e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:34.685542 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8fb51f07-7b92-4f6c-b465-dd76db9b81e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:34.764992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8fb51f07-7b92-4f6c-b465-dd76db9b81e0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28483 microversion: 2.1 time: 0.092388 Aug 30 07:57:34.765616 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 608/1268] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:34 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28483 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:35.479609 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fdcab69f-ad79-4e14-8b8f-90de6c1d3588 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:35.480599 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fdcab69f-ad79-4e14-8b8f-90de6c1d3588 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:35.487096 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fdcab69f-ad79-4e14-8b8f-90de6c1d3588 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:35.487540 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fdcab69f-ad79-4e14-8b8f-90de6c1d3588 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:35.488299 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fdcab69f-ad79-4e14-8b8f-90de6c1d3588 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:35.488725 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fdcab69f-ad79-4e14-8b8f-90de6c1d3588 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:35.551865 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fdcab69f-ad79-4e14-8b8f-90de6c1d3588 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.076509 Aug 30 07:57:35.552502 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 661/1269] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:35 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:35.777449 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c42e0fdb-3798-4855-9b41-38aba541a3a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:35.778382 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c42e0fdb-3798-4855-9b41-38aba541a3a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:35.785113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c42e0fdb-3798-4855-9b41-38aba541a3a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:35.785564 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c42e0fdb-3798-4855-9b41-38aba541a3a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:35.786378 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c42e0fdb-3798-4855-9b41-38aba541a3a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:35.786816 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c42e0fdb-3798-4855-9b41-38aba541a3a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:35.879127 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c42e0fdb-3798-4855-9b41-38aba541a3a8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28581 microversion: 2.1 time: 0.105873 Aug 30 07:57:35.879775 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 609/1270] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:35 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28581 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:36.564454 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b0c3c4d8-9dfa-4f0a-8368-fdd5111301ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:36.565503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b0c3c4d8-9dfa-4f0a-8368-fdd5111301ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:36.571944 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0c3c4d8-9dfa-4f0a-8368-fdd5111301ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:36.572387 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0c3c4d8-9dfa-4f0a-8368-fdd5111301ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:36.573149 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0c3c4d8-9dfa-4f0a-8368-fdd5111301ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:36.573573 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0c3c4d8-9dfa-4f0a-8368-fdd5111301ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:36.650423 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b0c3c4d8-9dfa-4f0a-8368-fdd5111301ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.089964 Aug 30 07:57:36.651068 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 662/1271] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:36 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:36.892008 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-88868e0d-7438-4362-97c1-f7fb1ebff2af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:36.893013 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-88868e0d-7438-4362-97c1-f7fb1ebff2af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:36.899513 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-88868e0d-7438-4362-97c1-f7fb1ebff2af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:36.899950 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-88868e0d-7438-4362-97c1-f7fb1ebff2af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:36.900742 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-88868e0d-7438-4362-97c1-f7fb1ebff2af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:36.901174 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-88868e0d-7438-4362-97c1-f7fb1ebff2af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:36.975325 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-88868e0d-7438-4362-97c1-f7fb1ebff2af tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.088042 Aug 30 07:57:36.976004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 610/1272] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:36 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:37.662958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cd78169d-6fa1-4057-b73e-a841d1082052 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:37.663955 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cd78169d-6fa1-4057-b73e-a841d1082052 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:37.671058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cd78169d-6fa1-4057-b73e-a841d1082052 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:37.671500 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cd78169d-6fa1-4057-b73e-a841d1082052 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:37.672854 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cd78169d-6fa1-4057-b73e-a841d1082052 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:37.673278 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cd78169d-6fa1-4057-b73e-a841d1082052 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:37.738385 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cd78169d-6fa1-4057-b73e-a841d1082052 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.079301 Aug 30 07:57:37.738959 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 663/1273] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:37 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:37.988105 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8e2d3025-0591-433e-8743-51c4d8c53ca2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:37.989693 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8e2d3025-0591-433e-8743-51c4d8c53ca2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:37.996095 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e2d3025-0591-433e-8743-51c4d8c53ca2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:37.996535 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e2d3025-0591-433e-8743-51c4d8c53ca2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:37.997438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e2d3025-0591-433e-8743-51c4d8c53ca2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:37.997868 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e2d3025-0591-433e-8743-51c4d8c53ca2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:38.063977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8e2d3025-0591-433e-8743-51c4d8c53ca2 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.080297 Aug 30 07:57:38.064608 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 611/1274] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:37 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:38.750599 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7cf3bf26-b877-4bc8-bddd-3701da6dd443 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:38.751596 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7cf3bf26-b877-4bc8-bddd-3701da6dd443 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:38.758019 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7cf3bf26-b877-4bc8-bddd-3701da6dd443 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:38.758488 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7cf3bf26-b877-4bc8-bddd-3701da6dd443 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:38.759241 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7cf3bf26-b877-4bc8-bddd-3701da6dd443 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:38.759671 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7cf3bf26-b877-4bc8-bddd-3701da6dd443 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:38.820743 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7cf3bf26-b877-4bc8-bddd-3701da6dd443 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.074224 Aug 30 07:57:38.821623 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 664/1275] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:38 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:39.076335 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f6928e31-b0ca-4025-ae80-316195d19a0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:39.077289 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f6928e31-b0ca-4025-ae80-316195d19a0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:39.083878 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6928e31-b0ca-4025-ae80-316195d19a0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:39.084324 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6928e31-b0ca-4025-ae80-316195d19a0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:39.085086 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6928e31-b0ca-4025-ae80-316195d19a0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:39.085526 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6928e31-b0ca-4025-ae80-316195d19a0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:39.151863 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f6928e31-b0ca-4025-ae80-316195d19a0c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.079540 Aug 30 07:57:39.152484 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 612/1276] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:39 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:39.833436 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d72bd846-ce41-438a-9ab4-9d9eb3d02f0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:39.834380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d72bd846-ce41-438a-9ab4-9d9eb3d02f0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:39.840944 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d72bd846-ce41-438a-9ab4-9d9eb3d02f0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:39.841407 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d72bd846-ce41-438a-9ab4-9d9eb3d02f0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:39.842566 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d72bd846-ce41-438a-9ab4-9d9eb3d02f0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:39.842685 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d72bd846-ce41-438a-9ab4-9d9eb3d02f0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:39.908787 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d72bd846-ce41-438a-9ab4-9d9eb3d02f0b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.079338 Aug 30 07:57:39.909652 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 665/1277] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:39 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:40.163830 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c51f1c72-1e8d-41cb-9159-23b4b034ddab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:40.164823 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c51f1c72-1e8d-41cb-9159-23b4b034ddab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:40.171274 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c51f1c72-1e8d-41cb-9159-23b4b034ddab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:40.171793 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c51f1c72-1e8d-41cb-9159-23b4b034ddab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:40.172654 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c51f1c72-1e8d-41cb-9159-23b4b034ddab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:40.173097 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c51f1c72-1e8d-41cb-9159-23b4b034ddab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:40.233680 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c51f1c72-1e8d-41cb-9159-23b4b034ddab tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.073757 Aug 30 07:57:40.234329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 613/1278] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:40 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:40.922384 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-429dd9ce-ce5a-4b5d-afe7-2c55a8aaa491 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:40.923414 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-429dd9ce-ce5a-4b5d-afe7-2c55a8aaa491 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:40.929966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-429dd9ce-ce5a-4b5d-afe7-2c55a8aaa491 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:40.930441 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-429dd9ce-ce5a-4b5d-afe7-2c55a8aaa491 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:40.931255 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-429dd9ce-ce5a-4b5d-afe7-2c55a8aaa491 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:40.931703 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-429dd9ce-ce5a-4b5d-afe7-2c55a8aaa491 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:40.993256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-429dd9ce-ce5a-4b5d-afe7-2c55a8aaa491 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.076237 Aug 30 07:57:40.994206 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 666/1279] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:40 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:41.246245 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ad42e860-3105-44ed-a4eb-b93f41be35ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:41.247183 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ad42e860-3105-44ed-a4eb-b93f41be35ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:41.253838 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ad42e860-3105-44ed-a4eb-b93f41be35ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:41.254350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ad42e860-3105-44ed-a4eb-b93f41be35ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:41.255143 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ad42e860-3105-44ed-a4eb-b93f41be35ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:41.255568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ad42e860-3105-44ed-a4eb-b93f41be35ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:41.327288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ad42e860-3105-44ed-a4eb-b93f41be35ee tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.085078 Aug 30 07:57:41.328442 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 614/1280] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:41 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:42.005593 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9ea6426b-73f3-4bea-bfa0-f149e0f01a82 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:42.006622 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9ea6426b-73f3-4bea-bfa0-f149e0f01a82 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:42.012992 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9ea6426b-73f3-4bea-bfa0-f149e0f01a82 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:42.013435 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9ea6426b-73f3-4bea-bfa0-f149e0f01a82 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:42.014216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9ea6426b-73f3-4bea-bfa0-f149e0f01a82 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:42.014649 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9ea6426b-73f3-4bea-bfa0-f149e0f01a82 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:42.080204 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9ea6426b-73f3-4bea-bfa0-f149e0f01a82 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.078508 Aug 30 07:57:42.080815 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 667/1281] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:42 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:42.339972 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-47ee1372-b4fe-485c-80c7-52e31ea5956d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:42.341005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-47ee1372-b4fe-485c-80c7-52e31ea5956d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:42.347429 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-47ee1372-b4fe-485c-80c7-52e31ea5956d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:42.347852 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-47ee1372-b4fe-485c-80c7-52e31ea5956d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:42.348609 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-47ee1372-b4fe-485c-80c7-52e31ea5956d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:42.349040 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-47ee1372-b4fe-485c-80c7-52e31ea5956d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:42.411124 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-47ee1372-b4fe-485c-80c7-52e31ea5956d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.075005 Aug 30 07:57:42.411769 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 615/1282] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:42 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:43.092378 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f550e22d-363b-4efe-80a3-319ffb0bb254 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:43.093874 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f550e22d-363b-4efe-80a3-319ffb0bb254 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:43.100497 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f550e22d-363b-4efe-80a3-319ffb0bb254 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:43.101192 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f550e22d-363b-4efe-80a3-319ffb0bb254 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:43.101959 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f550e22d-363b-4efe-80a3-319ffb0bb254 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:43.102427 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f550e22d-363b-4efe-80a3-319ffb0bb254 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:43.168578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f550e22d-363b-4efe-80a3-319ffb0bb254 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.080068 Aug 30 07:57:43.172978 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 668/1283] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:43 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:43.423777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b5ae5579-ff5c-4067-8cbe-309bfca1de5d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:43.424807 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b5ae5579-ff5c-4067-8cbe-309bfca1de5d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:43.431370 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b5ae5579-ff5c-4067-8cbe-309bfca1de5d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:43.431822 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b5ae5579-ff5c-4067-8cbe-309bfca1de5d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:43.432594 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b5ae5579-ff5c-4067-8cbe-309bfca1de5d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:43.433030 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b5ae5579-ff5c-4067-8cbe-309bfca1de5d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:43.511915 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b5ae5579-ff5c-4067-8cbe-309bfca1de5d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.092661 Aug 30 07:57:43.512546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 616/1284] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:43 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:44.181676 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8937f8c4-25fa-4466-9f34-9c0ffb8dd1c4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:44.182696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8937f8c4-25fa-4466-9f34-9c0ffb8dd1c4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:44.189757 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8937f8c4-25fa-4466-9f34-9c0ffb8dd1c4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:44.190227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8937f8c4-25fa-4466-9f34-9c0ffb8dd1c4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:44.190982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8937f8c4-25fa-4466-9f34-9c0ffb8dd1c4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:44.191410 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8937f8c4-25fa-4466-9f34-9c0ffb8dd1c4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:44.255157 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8937f8c4-25fa-4466-9f34-9c0ffb8dd1c4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.077440 Aug 30 07:57:44.256727 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 669/1285] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:44 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:57:44.524777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2b5ef2a8-0512-460e-93dd-5e5aae3bd692 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:44.525676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2b5ef2a8-0512-460e-93dd-5e5aae3bd692 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:44.532715 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b5ef2a8-0512-460e-93dd-5e5aae3bd692 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:44.533179 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b5ef2a8-0512-460e-93dd-5e5aae3bd692 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:44.533935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b5ef2a8-0512-460e-93dd-5e5aae3bd692 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:44.534408 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b5ef2a8-0512-460e-93dd-5e5aae3bd692 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:44.595706 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2b5ef2a8-0512-460e-93dd-5e5aae3bd692 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.074901 Aug 30 07:57:44.596322 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 617/1286] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:44 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:45.268660 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-725ef4a6-af2e-4346-a40c-a332714f2967 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:45.269589 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-725ef4a6-af2e-4346-a40c-a332714f2967 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:45.276024 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-725ef4a6-af2e-4346-a40c-a332714f2967 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:45.276477 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-725ef4a6-af2e-4346-a40c-a332714f2967 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:45.277283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-725ef4a6-af2e-4346-a40c-a332714f2967 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:45.277956 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-725ef4a6-af2e-4346-a40c-a332714f2967 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:45.343895 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-725ef4a6-af2e-4346-a40c-a332714f2967 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.080471 Aug 30 07:57:45.344662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 670/1287] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:45 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:45.607904 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ae166d05-2add-49c6-a15d-6f0fd8f8849d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:45.609477 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ae166d05-2add-49c6-a15d-6f0fd8f8849d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:45.616202 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae166d05-2add-49c6-a15d-6f0fd8f8849d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:45.616647 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae166d05-2add-49c6-a15d-6f0fd8f8849d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:45.617420 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae166d05-2add-49c6-a15d-6f0fd8f8849d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:45.617858 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ae166d05-2add-49c6-a15d-6f0fd8f8849d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:45.684016 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ae166d05-2add-49c6-a15d-6f0fd8f8849d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.079912 Aug 30 07:57:45.684650 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 618/1288] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:45 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:46.356254 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2b32fe80-98e9-4e34-9ab9-98cb65803f44 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:46.357276 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2b32fe80-98e9-4e34-9ab9-98cb65803f44 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:46.365564 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2b32fe80-98e9-4e34-9ab9-98cb65803f44 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:46.366037 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2b32fe80-98e9-4e34-9ab9-98cb65803f44 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:46.367004 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2b32fe80-98e9-4e34-9ab9-98cb65803f44 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:46.367438 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2b32fe80-98e9-4e34-9ab9-98cb65803f44 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:46.427786 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2b32fe80-98e9-4e34-9ab9-98cb65803f44 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.075456 Aug 30 07:57:46.428435 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 671/1289] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:46 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:57:46.697304 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7c68680c-079f-4278-83a6-0db57fc0d51d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:46.698249 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7c68680c-079f-4278-83a6-0db57fc0d51d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:46.705339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7c68680c-079f-4278-83a6-0db57fc0d51d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:46.705792 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7c68680c-079f-4278-83a6-0db57fc0d51d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:46.706597 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7c68680c-079f-4278-83a6-0db57fc0d51d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:46.707036 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7c68680c-079f-4278-83a6-0db57fc0d51d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:46.778748 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7c68680c-079f-4278-83a6-0db57fc0d51d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.085461 Aug 30 07:57:46.779374 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 619/1290] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:46 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:47.440077 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-bfafa101-70c4-485b-b704-16666ccbe4d2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:47.441075 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-bfafa101-70c4-485b-b704-16666ccbe4d2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:47.447560 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bfafa101-70c4-485b-b704-16666ccbe4d2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:47.447998 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bfafa101-70c4-485b-b704-16666ccbe4d2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:47.448748 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bfafa101-70c4-485b-b704-16666ccbe4d2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:47.449174 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-bfafa101-70c4-485b-b704-16666ccbe4d2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:47.518689 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-bfafa101-70c4-485b-b704-16666ccbe4d2 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.082647 Aug 30 07:57:47.519326 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 672/1291] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:47 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:57:47.790992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-47d83c92-b5fe-4365-bd08-489e4abaf84e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:47.791937 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-47d83c92-b5fe-4365-bd08-489e4abaf84e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:47.798495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-47d83c92-b5fe-4365-bd08-489e4abaf84e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:47.798943 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-47d83c92-b5fe-4365-bd08-489e4abaf84e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:47.799716 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-47d83c92-b5fe-4365-bd08-489e4abaf84e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:47.800155 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-47d83c92-b5fe-4365-bd08-489e4abaf84e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:47.864815 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-47d83c92-b5fe-4365-bd08-489e4abaf84e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.077774 Aug 30 07:57:47.865448 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 620/1292] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:47 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:48.531307 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e167271a-3482-49c5-a932-ce020715ff01 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:48.532313 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e167271a-3482-49c5-a932-ce020715ff01 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:48.538826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e167271a-3482-49c5-a932-ce020715ff01 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:48.539267 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e167271a-3482-49c5-a932-ce020715ff01 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:48.540015 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e167271a-3482-49c5-a932-ce020715ff01 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:48.540441 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e167271a-3482-49c5-a932-ce020715ff01 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:48.601595 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e167271a-3482-49c5-a932-ce020715ff01 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.074776 Aug 30 07:57:48.602271 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 673/1293] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:48 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:48.876117 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-27e5d868-f4f9-407e-ba68-471e79b7b970 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:48.877106 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-27e5d868-f4f9-407e-ba68-471e79b7b970 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:48.883564 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27e5d868-f4f9-407e-ba68-471e79b7b970 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:48.884013 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27e5d868-f4f9-407e-ba68-471e79b7b970 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:48.884780 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27e5d868-f4f9-407e-ba68-471e79b7b970 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:48.885212 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27e5d868-f4f9-407e-ba68-471e79b7b970 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:48.946826 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-27e5d868-f4f9-407e-ba68-471e79b7b970 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.074580 Aug 30 07:57:48.947474 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 621/1294] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:48 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:57:49.614680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d012c548-b36e-409d-89f1-ed136d8dcd7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:49.615681 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d012c548-b36e-409d-89f1-ed136d8dcd7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:49.622166 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d012c548-b36e-409d-89f1-ed136d8dcd7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:49.622616 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d012c548-b36e-409d-89f1-ed136d8dcd7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:49.623375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d012c548-b36e-409d-89f1-ed136d8dcd7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:49.623801 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d012c548-b36e-409d-89f1-ed136d8dcd7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:49.688565 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d012c548-b36e-409d-89f1-ed136d8dcd7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.077957 Aug 30 07:57:49.689233 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 674/1295] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:49 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:57:49.959052 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bfbed0b1-e53c-4c92-a5ac-09dacef67466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:49.960035 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bfbed0b1-e53c-4c92-a5ac-09dacef67466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:49.966699 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bfbed0b1-e53c-4c92-a5ac-09dacef67466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:49.967171 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bfbed0b1-e53c-4c92-a5ac-09dacef67466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:49.968733 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bfbed0b1-e53c-4c92-a5ac-09dacef67466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:49.969164 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bfbed0b1-e53c-4c92-a5ac-09dacef67466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:50.027254 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bfbed0b1-e53c-4c92-a5ac-09dacef67466 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.072146 Aug 30 07:57:50.027884 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 622/1296] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:49 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:50.700731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-473a8786-dc22-4e76-8472-51b1990a39b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:50.701733 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-473a8786-dc22-4e76-8472-51b1990a39b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:50.708890 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-473a8786-dc22-4e76-8472-51b1990a39b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:50.709333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-473a8786-dc22-4e76-8472-51b1990a39b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:50.710086 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-473a8786-dc22-4e76-8472-51b1990a39b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:50.710543 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-473a8786-dc22-4e76-8472-51b1990a39b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:50.769496 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-473a8786-dc22-4e76-8472-51b1990a39b3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.072760 Aug 30 07:57:50.770446 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 675/1297] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:50 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:51.039817 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-284eaafa-e0eb-45c7-8381-5085499b77e6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:51.040838 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-284eaafa-e0eb-45c7-8381-5085499b77e6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:51.048006 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-284eaafa-e0eb-45c7-8381-5085499b77e6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:51.048455 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-284eaafa-e0eb-45c7-8381-5085499b77e6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:51.049227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-284eaafa-e0eb-45c7-8381-5085499b77e6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:51.049663 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-284eaafa-e0eb-45c7-8381-5085499b77e6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:51.110571 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-284eaafa-e0eb-45c7-8381-5085499b77e6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.074543 Aug 30 07:57:51.111211 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 623/1298] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:51 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:51.782537 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-54faf300-688b-48e8-8bd1-c8017ec69e81 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:51.783461 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-54faf300-688b-48e8-8bd1-c8017ec69e81 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:51.789846 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54faf300-688b-48e8-8bd1-c8017ec69e81 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:51.790329 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54faf300-688b-48e8-8bd1-c8017ec69e81 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:51.791099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54faf300-688b-48e8-8bd1-c8017ec69e81 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:51.791530 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-54faf300-688b-48e8-8bd1-c8017ec69e81 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:51.857439 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-54faf300-688b-48e8-8bd1-c8017ec69e81 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.079733 Aug 30 07:57:51.858379 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 676/1299] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:51 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:52.122667 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e6a74332-683b-4c4a-8108-2146bcd7e381 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:52.123661 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e6a74332-683b-4c4a-8108-2146bcd7e381 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:52.130775 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e6a74332-683b-4c4a-8108-2146bcd7e381 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:52.131224 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e6a74332-683b-4c4a-8108-2146bcd7e381 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:52.131991 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e6a74332-683b-4c4a-8108-2146bcd7e381 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:52.132427 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e6a74332-683b-4c4a-8108-2146bcd7e381 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:52.191336 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e6a74332-683b-4c4a-8108-2146bcd7e381 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.072571 Aug 30 07:57:52.191958 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 624/1300] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:52 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:52.869370 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-95ded362-198e-455c-ac81-275d58cd5d14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:52.870402 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-95ded362-198e-455c-ac81-275d58cd5d14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:52.877546 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95ded362-198e-455c-ac81-275d58cd5d14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:52.878004 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95ded362-198e-455c-ac81-275d58cd5d14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:52.878783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95ded362-198e-455c-ac81-275d58cd5d14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:52.879217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95ded362-198e-455c-ac81-275d58cd5d14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:52.951773 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-95ded362-198e-455c-ac81-275d58cd5d14 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.086284 Aug 30 07:57:52.952664 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 677/1301] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:52 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:57:53.275502 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7041db2e-290c-4084-a4f2-52d6ea076668 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:53.276548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7041db2e-290c-4084-a4f2-52d6ea076668 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:53.282941 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7041db2e-290c-4084-a4f2-52d6ea076668 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:53.283418 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7041db2e-290c-4084-a4f2-52d6ea076668 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:53.284233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7041db2e-290c-4084-a4f2-52d6ea076668 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:53.284723 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7041db2e-290c-4084-a4f2-52d6ea076668 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:53.351339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7041db2e-290c-4084-a4f2-52d6ea076668 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.152213 Aug 30 07:57:53.351954 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 625/1302] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:53 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:53.964735 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-171203be-fdcb-4b2d-a8e6-a5385f07b8eb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:53.966206 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-171203be-fdcb-4b2d-a8e6-a5385f07b8eb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:53.972968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-171203be-fdcb-4b2d-a8e6-a5385f07b8eb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:53.973348 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-171203be-fdcb-4b2d-a8e6-a5385f07b8eb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:53.974120 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-171203be-fdcb-4b2d-a8e6-a5385f07b8eb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:53.974579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-171203be-fdcb-4b2d-a8e6-a5385f07b8eb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:54.056242 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-171203be-fdcb-4b2d-a8e6-a5385f07b8eb tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.095531 Aug 30 07:57:54.057106 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 678/1303] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:53 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:54.363986 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-815f2cdc-2f2c-46dd-9a16-34216ad5b4a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:54.364977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-815f2cdc-2f2c-46dd-9a16-34216ad5b4a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:54.371609 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-815f2cdc-2f2c-46dd-9a16-34216ad5b4a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:54.372052 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-815f2cdc-2f2c-46dd-9a16-34216ad5b4a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:54.372817 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-815f2cdc-2f2c-46dd-9a16-34216ad5b4a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:54.373246 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-815f2cdc-2f2c-46dd-9a16-34216ad5b4a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:54.471136 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-815f2cdc-2f2c-46dd-9a16-34216ad5b4a3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.111258 Aug 30 07:57:54.472029 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 626/1304] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:54 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:57:55.073720 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-257116fa-9a67-4c77-9ed6-86cb348d24fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:55.074754 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-257116fa-9a67-4c77-9ed6-86cb348d24fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:55.081393 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-257116fa-9a67-4c77-9ed6-86cb348d24fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:55.081844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-257116fa-9a67-4c77-9ed6-86cb348d24fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:55.082654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-257116fa-9a67-4c77-9ed6-86cb348d24fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:55.083098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-257116fa-9a67-4c77-9ed6-86cb348d24fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:55.227526 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-257116fa-9a67-4c77-9ed6-86cb348d24fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.157589 Aug 30 07:57:55.228091 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 679/1305] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:55 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:57:55.483528 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9129f576-1f1b-4ee5-a585-3689433a547f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:55.484484 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9129f576-1f1b-4ee5-a585-3689433a547f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:55.490889 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9129f576-1f1b-4ee5-a585-3689433a547f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:55.491332 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9129f576-1f1b-4ee5-a585-3689433a547f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:55.492084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9129f576-1f1b-4ee5-a585-3689433a547f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:55.492511 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9129f576-1f1b-4ee5-a585-3689433a547f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:55.563124 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9129f576-1f1b-4ee5-a585-3689433a547f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.083387 Aug 30 07:57:55.563734 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 627/1306] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:55 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:57:56.239439 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c63ea293-86dd-41d9-927c-40389847b758 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:56.240365 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c63ea293-86dd-41d9-927c-40389847b758 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:56.246812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c63ea293-86dd-41d9-927c-40389847b758 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:56.247260 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c63ea293-86dd-41d9-927c-40389847b758 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:56.248027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c63ea293-86dd-41d9-927c-40389847b758 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:56.248464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c63ea293-86dd-41d9-927c-40389847b758 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:56.321700 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c63ea293-86dd-41d9-927c-40389847b758 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.086946 Aug 30 07:57:56.322346 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 680/1307] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:56 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:56.575473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1b992072-9f27-4d7f-a364-a8831eae27f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:56.576375 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1b992072-9f27-4d7f-a364-a8831eae27f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:56.582919 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b992072-9f27-4d7f-a364-a8831eae27f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:56.583364 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b992072-9f27-4d7f-a364-a8831eae27f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:56.584133 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b992072-9f27-4d7f-a364-a8831eae27f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:56.584590 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1b992072-9f27-4d7f-a364-a8831eae27f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:56.645536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1b992072-9f27-4d7f-a364-a8831eae27f3 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.073975 Aug 30 07:57:56.646189 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 628/1308] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:56 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:57.334617 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6ffbe7a7-a923-4425-9554-ba0c4c025a52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:57.335590 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6ffbe7a7-a923-4425-9554-ba0c4c025a52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:57.341960 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ffbe7a7-a923-4425-9554-ba0c4c025a52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:57.342445 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ffbe7a7-a923-4425-9554-ba0c4c025a52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:57.343201 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ffbe7a7-a923-4425-9554-ba0c4c025a52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:57.343629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ffbe7a7-a923-4425-9554-ba0c4c025a52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:57.407517 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6ffbe7a7-a923-4425-9554-ba0c4c025a52 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.077039 Aug 30 07:57:57.408162 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 681/1309] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:57 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:57.657861 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a3837efd-c60e-477f-925b-4a35432a5c6e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:57.658879 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a3837efd-c60e-477f-925b-4a35432a5c6e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:57.665485 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a3837efd-c60e-477f-925b-4a35432a5c6e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:57.665925 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a3837efd-c60e-477f-925b-4a35432a5c6e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:57.666712 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a3837efd-c60e-477f-925b-4a35432a5c6e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:57.667141 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a3837efd-c60e-477f-925b-4a35432a5c6e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:57.728536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a3837efd-c60e-477f-925b-4a35432a5c6e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.074523 Aug 30 07:57:57.729150 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 629/1310] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:57 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:57:58.418687 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-19682523-54bc-485b-9bf7-1ff965602558 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:58.419801 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-19682523-54bc-485b-9bf7-1ff965602558 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:58.426357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-19682523-54bc-485b-9bf7-1ff965602558 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:58.426797 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-19682523-54bc-485b-9bf7-1ff965602558 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:58.427568 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-19682523-54bc-485b-9bf7-1ff965602558 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:58.427993 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-19682523-54bc-485b-9bf7-1ff965602558 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:58.504913 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-19682523-54bc-485b-9bf7-1ff965602558 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.090109 Aug 30 07:57:58.505560 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 682/1311] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:58 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:58.740555 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-eee8e069-4e9e-4e5e-86d4-f4fab4582cd0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:58.741530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-eee8e069-4e9e-4e5e-86d4-f4fab4582cd0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:58.756728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eee8e069-4e9e-4e5e-86d4-f4fab4582cd0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:58.757179 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eee8e069-4e9e-4e5e-86d4-f4fab4582cd0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:58.757965 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eee8e069-4e9e-4e5e-86d4-f4fab4582cd0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:58.758430 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-eee8e069-4e9e-4e5e-86d4-f4fab4582cd0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:58.830659 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-eee8e069-4e9e-4e5e-86d4-f4fab4582cd0 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.094375 Aug 30 07:57:58.831343 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 630/1312] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:58 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:57:59.517036 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1969d796-6a67-4b8a-8eda-b6bc8c65ccef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:59.518050 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1969d796-6a67-4b8a-8eda-b6bc8c65ccef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:59.524515 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1969d796-6a67-4b8a-8eda-b6bc8c65ccef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:59.524950 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1969d796-6a67-4b8a-8eda-b6bc8c65ccef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:59.525706 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1969d796-6a67-4b8a-8eda-b6bc8c65ccef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:59.526135 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1969d796-6a67-4b8a-8eda-b6bc8c65ccef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:59.585488 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1969d796-6a67-4b8a-8eda-b6bc8c65ccef tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.072454 Aug 30 07:57:59.586448 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 683/1313] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:57:59 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:57:59.842890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0510c021-7065-48be-8938-554e1de3216b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:57:59.843893 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0510c021-7065-48be-8938-554e1de3216b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:57:59.850702 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0510c021-7065-48be-8938-554e1de3216b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:59.851141 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0510c021-7065-48be-8938-554e1de3216b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:59.851895 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0510c021-7065-48be-8938-554e1de3216b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:57:59.852321 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0510c021-7065-48be-8938-554e1de3216b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:57:59.911831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0510c021-7065-48be-8938-554e1de3216b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.072796 Aug 30 07:57:59.912457 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 631/1314] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:57:59 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:00.598137 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2dde9ef4-4246-4938-9924-64a078bbd5ab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:00.599221 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2dde9ef4-4246-4938-9924-64a078bbd5ab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:00.606095 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2dde9ef4-4246-4938-9924-64a078bbd5ab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:00.606569 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2dde9ef4-4246-4938-9924-64a078bbd5ab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:00.607340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2dde9ef4-4246-4938-9924-64a078bbd5ab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:00.607770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2dde9ef4-4246-4938-9924-64a078bbd5ab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:00.686059 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2dde9ef4-4246-4938-9924-64a078bbd5ab tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.092454 Aug 30 07:58:00.686991 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 684/1315] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:00 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:00.923990 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9722d9f1-db56-46f4-b827-7c53a93b2334 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:00.925002 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9722d9f1-db56-46f4-b827-7c53a93b2334 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:00.931442 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9722d9f1-db56-46f4-b827-7c53a93b2334 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:00.931827 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9722d9f1-db56-46f4-b827-7c53a93b2334 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:00.932583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9722d9f1-db56-46f4-b827-7c53a93b2334 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:00.933014 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9722d9f1-db56-46f4-b827-7c53a93b2334 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:00.997395 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9722d9f1-db56-46f4-b827-7c53a93b2334 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.077625 Aug 30 07:58:00.998285 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 632/1316] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:00 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:01.324934 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d42a1585-3483-4366-a8aa-18e0531a56e7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1355206187"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:01.325535 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d42a1585-3483-4366-a8aa-18e0531a56e7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:01.332814 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d42a1585-3483-4366-a8aa-18e0531a56e7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:01.333258 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d42a1585-3483-4366-a8aa-18e0531a56e7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:01.334015 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d42a1585-3483-4366-a8aa-18e0531a56e7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:01.334549 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d42a1585-3483-4366-a8aa-18e0531a56e7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:01.508420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.network.security_group_api [None req-d42a1585-3483-4366-a8aa-18e0531a56e7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Removing security group 41342c03-de87-44e0-b0f0-9cb0deee3e59 from port 17a5b7fe-6ea4-4a61-995f-35648fa60831 Aug 30 07:58:01.698350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c998877d-1c76-4096-8d0d-f7e4cb5c6cc8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:01.699351 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c998877d-1c76-4096-8d0d-f7e4cb5c6cc8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:01.705865 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c998877d-1c76-4096-8d0d-f7e4cb5c6cc8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:01.706359 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c998877d-1c76-4096-8d0d-f7e4cb5c6cc8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:01.707127 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c998877d-1c76-4096-8d0d-f7e4cb5c6cc8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:01.707561 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c998877d-1c76-4096-8d0d-f7e4cb5c6cc8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:01.783899 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c998877d-1c76-4096-8d0d-f7e4cb5c6cc8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.089657 Aug 30 07:58:01.784563 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 633/1317] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:01 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:58:01.845512 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d42a1585-3483-4366-a8aa-18e0531a56e7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "POST /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/action" status: 202 len: 0 microversion: 2.1 time: 0.524755 Aug 30 07:58:01.846989 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 685/1318] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:01 2021] POST /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:01.860602 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-8662f342-19d0-4de2-8ee8-3958631ee063 req-4c0e36d0-0b7a-45e4-8f98-31692dbed678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35", "tag": "17a5b7fe-6ea4-4a61-995f-35648fa60831"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:01.862510 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:58:01.862510 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:58:01.878598 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-8662f342-19d0-4de2-8ee8-3958631ee063 req-4c0e36d0-0b7a-45e4-8f98-31692dbed678 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:01.879046 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-8662f342-19d0-4de2-8ee8-3958631ee063 req-4c0e36d0-0b7a-45e4-8f98-31692dbed678 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:01.898997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-8662f342-19d0-4de2-8ee8-3958631ee063 req-4c0e36d0-0b7a-45e4-8f98-31692dbed678 service nova] Creating event network-changed:17a5b7fe-6ea4-4a61-995f-35648fa60831 for instance c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 on hv-cinder-80619 Aug 30 07:58:01.904274 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-8662f342-19d0-4de2-8ee8-3958631ee063 req-4c0e36d0-0b7a-45e4-8f98-31692dbed678 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048864 Aug 30 07:58:01.904892 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 634/1319] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:58:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:58:02.008785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6f50bfb2-1378-4b0b-996e-13c64117fbb8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:02.010229 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6f50bfb2-1378-4b0b-996e-13c64117fbb8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:02.016609 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f50bfb2-1378-4b0b-996e-13c64117fbb8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:02.017407 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f50bfb2-1378-4b0b-996e-13c64117fbb8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:02.018480 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f50bfb2-1378-4b0b-996e-13c64117fbb8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:02.019132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f50bfb2-1378-4b0b-996e-13c64117fbb8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:02.085523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6f50bfb2-1378-4b0b-996e-13c64117fbb8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.080112 Aug 30 07:58:02.086207 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 686/1320] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:02 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:02.796201 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-33d3e9dd-6492-4bea-a183-6b0cb985b85f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:02.797751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-33d3e9dd-6492-4bea-a183-6b0cb985b85f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:02.804039 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-33d3e9dd-6492-4bea-a183-6b0cb985b85f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:02.804495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-33d3e9dd-6492-4bea-a183-6b0cb985b85f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:02.805264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-33d3e9dd-6492-4bea-a183-6b0cb985b85f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:02.805697 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-33d3e9dd-6492-4bea-a183-6b0cb985b85f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:02.875210 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-33d3e9dd-6492-4bea-a183-6b0cb985b85f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.082126 Aug 30 07:58:02.879215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 635/1321] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:02 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:03.075043 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0e0c75f3-6de6-4326-a4df-18f8a7ca4391 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:03.075633 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0e0c75f3-6de6-4326-a4df-18f8a7ca4391 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:03.082646 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0e0c75f3-6de6-4326-a4df-18f8a7ca4391 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:03.083228 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0e0c75f3-6de6-4326-a4df-18f8a7ca4391 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:03.083996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0e0c75f3-6de6-4326-a4df-18f8a7ca4391 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:03.084429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0e0c75f3-6de6-4326-a4df-18f8a7ca4391 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:03.098464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6f74414b-56b0-4930-b772-ef361ebc58da tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:03.099809 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6f74414b-56b0-4930-b772-ef361ebc58da tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:03.106851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f74414b-56b0-4930-b772-ef361ebc58da tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:03.107299 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f74414b-56b0-4930-b772-ef361ebc58da tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:03.108102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f74414b-56b0-4930-b772-ef361ebc58da tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:03.108540 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f74414b-56b0-4930-b772-ef361ebc58da tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:03.177781 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-0e0c75f3-6de6-4326-a4df-18f8a7ca4391 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lazy-loading 'services' on Instance uuid c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:58:03.189701 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6f74414b-56b0-4930-b772-ef361ebc58da tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.096182 Aug 30 07:58:03.193637 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 636/1322] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:03 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:03.243123 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0e0c75f3-6de6-4326-a4df-18f8a7ca4391 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/os-volume_attachments/ee6f77df-f87b-400d-a298-32c6b7ff555d" status: 202 len: 0 microversion: 2.1 time: 0.172261 Aug 30 07:58:03.243705 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 687/1323] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:58:03 2021] DELETE /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/os-volume_attachments/ee6f77df-f87b-400d-a298-32c6b7ff555d => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:03.254533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-429952c2-b102-4d9f-839f-504f68dabbef tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:03.256008 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-429952c2-b102-4d9f-839f-504f68dabbef tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:03.262718 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-429952c2-b102-4d9f-839f-504f68dabbef tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:03.263430 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-429952c2-b102-4d9f-839f-504f68dabbef tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:03.264442 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-429952c2-b102-4d9f-839f-504f68dabbef tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:03.265964 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-429952c2-b102-4d9f-839f-504f68dabbef tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:03.296096 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-429952c2-b102-4d9f-839f-504f68dabbef tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047660 Aug 30 07:58:03.297026 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 637/1324] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:58:03 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:58:03.888129 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-724cad1c-ddb7-40af-a7f1-64b5e033a166 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:03.889139 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-724cad1c-ddb7-40af-a7f1-64b5e033a166 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:03.895693 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-724cad1c-ddb7-40af-a7f1-64b5e033a166 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:03.896183 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-724cad1c-ddb7-40af-a7f1-64b5e033a166 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:03.896928 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-724cad1c-ddb7-40af-a7f1-64b5e033a166 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:03.897605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-724cad1c-ddb7-40af-a7f1-64b5e033a166 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:03.919952 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-d1236429-3d57-4cc3-b5c4-2bbfa8385682 req-6599d0b7-9b57-416c-8ccc-d9f4bed83d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35", "tag": "17a5b7fe-6ea4-4a61-995f-35648fa60831"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:03.922261 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:58:03.922261 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:58:03.929385 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-d1236429-3d57-4cc3-b5c4-2bbfa8385682 req-6599d0b7-9b57-416c-8ccc-d9f4bed83d75 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:03.929838 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-d1236429-3d57-4cc3-b5c4-2bbfa8385682 req-6599d0b7-9b57-416c-8ccc-d9f4bed83d75 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:03.942016 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-d1236429-3d57-4cc3-b5c4-2bbfa8385682 req-6599d0b7-9b57-416c-8ccc-d9f4bed83d75 service nova] Creating event network-changed:17a5b7fe-6ea4-4a61-995f-35648fa60831 for instance c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 on hv-cinder-80619 Aug 30 07:58:03.947045 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-d1236429-3d57-4cc3-b5c4-2bbfa8385682 req-6599d0b7-9b57-416c-8ccc-d9f4bed83d75 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030590 Aug 30 07:58:03.947962 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 638/1325] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:58:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:58:03.974701 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-724cad1c-ddb7-40af-a7f1-64b5e033a166 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.090234 Aug 30 07:58:03.975345 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 688/1326] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:03 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:58:04.201668 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3f52b20e-5791-4232-9fd1-9b9a00c42d09 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:04.202913 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3f52b20e-5791-4232-9fd1-9b9a00c42d09 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:04.209157 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3f52b20e-5791-4232-9fd1-9b9a00c42d09 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:04.209635 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3f52b20e-5791-4232-9fd1-9b9a00c42d09 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:04.210454 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3f52b20e-5791-4232-9fd1-9b9a00c42d09 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:04.210897 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3f52b20e-5791-4232-9fd1-9b9a00c42d09 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:04.274442 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3f52b20e-5791-4232-9fd1-9b9a00c42d09 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.076330 Aug 30 07:58:04.278489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 639/1327] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:04 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:04.310369 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0adc8fbc-76f9-42dd-a836-4f78b82c2f75 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:04.311501 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0adc8fbc-76f9-42dd-a836-4f78b82c2f75 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:04.318989 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0adc8fbc-76f9-42dd-a836-4f78b82c2f75 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:04.319982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0adc8fbc-76f9-42dd-a836-4f78b82c2f75 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:04.320648 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0adc8fbc-76f9-42dd-a836-4f78b82c2f75 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:04.321092 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0adc8fbc-76f9-42dd-a836-4f78b82c2f75 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:04.352920 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0adc8fbc-76f9-42dd-a836-4f78b82c2f75 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047129 Aug 30 07:58:04.353683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 689/1328] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:58:04 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:58:04.364434 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1976c491-df38-4148-b69a-334de49e55d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:04.364912 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1976c491-df38-4148-b69a-334de49e55d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:04.371603 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1976c491-df38-4148-b69a-334de49e55d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:04.371946 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1976c491-df38-4148-b69a-334de49e55d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:04.372911 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1976c491-df38-4148-b69a-334de49e55d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:04.373344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1976c491-df38-4148-b69a-334de49e55d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:04.586983 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-1976c491-df38-4148-b69a-334de49e55d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] HTTP exception thrown: Instance c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 is not attached to volume ee6f77df-f87b-400d-a298-32c6b7ff555d Aug 30 07:58:04.587591 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1976c491-df38-4148-b69a-334de49e55d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Returning 404 to user: Instance c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 is not attached to volume ee6f77df-f87b-400d-a298-32c6b7ff555d {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:58:04.588445 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1976c491-df38-4148-b69a-334de49e55d1 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/os-volume_attachments/ee6f77df-f87b-400d-a298-32c6b7ff555d" status: 404 len: 154 microversion: 2.1 time: 0.228793 Aug 30 07:58:04.589024 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 640/1329] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:58:04 2021] DELETE /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35/os-volume_attachments/ee6f77df-f87b-400d-a298-32c6b7ff555d => generated 154 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:58:04.986570 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d878a222-6e0b-44e4-9fcf-9165acbbb5e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:04.987504 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d878a222-6e0b-44e4-9fcf-9165acbbb5e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:04.993349 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d878a222-6e0b-44e4-9fcf-9165acbbb5e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:04.993792 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d878a222-6e0b-44e4-9fcf-9165acbbb5e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:04.994592 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d878a222-6e0b-44e4-9fcf-9165acbbb5e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:04.995028 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d878a222-6e0b-44e4-9fcf-9165acbbb5e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:05.064837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d878a222-6e0b-44e4-9fcf-9165acbbb5e6 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28625 microversion: 2.20 time: 0.082118 Aug 30 07:58:05.065463 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 690/1330] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:04 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28625 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:05.285636 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0cecc7da-e674-437d-aeab-4a64e1f6227e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:05.286503 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0cecc7da-e674-437d-aeab-4a64e1f6227e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:05.292338 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0cecc7da-e674-437d-aeab-4a64e1f6227e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:05.292787 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0cecc7da-e674-437d-aeab-4a64e1f6227e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:05.293552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0cecc7da-e674-437d-aeab-4a64e1f6227e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:05.293988 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0cecc7da-e674-437d-aeab-4a64e1f6227e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:05.366314 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0cecc7da-e674-437d-aeab-4a64e1f6227e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.084394 Aug 30 07:58:05.366917 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 641/1331] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:05 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:05.737982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ebe31187-5ef9-42c0-947c-1c942c47ab86 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:05.738614 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ebe31187-5ef9-42c0-947c-1c942c47ab86 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:05.745049 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ebe31187-5ef9-42c0-947c-1c942c47ab86 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:05.745498 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ebe31187-5ef9-42c0-947c-1c942c47ab86 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:05.746292 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ebe31187-5ef9-42c0-947c-1c942c47ab86 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:05.746729 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ebe31187-5ef9-42c0-947c-1c942c47ab86 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:05.770551 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ebe31187-5ef9-42c0-947c-1c942c47ab86 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:58:05.841578 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ebe31187-5ef9-42c0-947c-1c942c47ab86 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 204 len: 0 microversion: 2.1 time: 0.107916 Aug 30 07:58:05.843008 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 691/1332] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:58:05 2021] DELETE /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:58:05.852411 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e96b6210-f598-4980-b297-6e0a0b2a97a9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:05.853144 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e96b6210-f598-4980-b297-6e0a0b2a97a9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:05.859922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e96b6210-f598-4980-b297-6e0a0b2a97a9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:05.860372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e96b6210-f598-4980-b297-6e0a0b2a97a9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:05.861150 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e96b6210-f598-4980-b297-6e0a0b2a97a9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:05.861584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e96b6210-f598-4980-b297-6e0a0b2a97a9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:06.078292 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-15270fb1-8a45-4207-95b1-7bf32787c282 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:06.079374 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-15270fb1-8a45-4207-95b1-7bf32787c282 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:06.085045 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-15270fb1-8a45-4207-95b1-7bf32787c282 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:06.085491 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-15270fb1-8a45-4207-95b1-7bf32787c282 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:06.086282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-15270fb1-8a45-4207-95b1-7bf32787c282 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:06.086713 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-15270fb1-8a45-4207-95b1-7bf32787c282 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:06.142568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e96b6210-f598-4980-b297-6e0a0b2a97a9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:06.149784 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e96b6210-f598-4980-b297-6e0a0b2a97a9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1555 microversion: 2.1 time: 0.301888 Aug 30 07:58:06.150381 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 642/1333] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:58:05 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1555 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:58:06.161956 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-15270fb1-8a45-4207-95b1-7bf32787c282 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 28650 microversion: 2.20 time: 0.088347 Aug 30 07:58:06.162645 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 692/1334] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:06 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 28650 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:58:06.378365 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ac5ff1cf-c12a-4ea1-8924-dd8e78c57dfb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:06.379367 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ac5ff1cf-c12a-4ea1-8924-dd8e78c57dfb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:06.385119 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ac5ff1cf-c12a-4ea1-8924-dd8e78c57dfb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:06.385578 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ac5ff1cf-c12a-4ea1-8924-dd8e78c57dfb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:06.386381 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ac5ff1cf-c12a-4ea1-8924-dd8e78c57dfb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:06.386827 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ac5ff1cf-c12a-4ea1-8924-dd8e78c57dfb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:06.447693 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ac5ff1cf-c12a-4ea1-8924-dd8e78c57dfb tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.074009 Aug 30 07:58:06.448296 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 643/1335] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:06 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:07.167983 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-78289354-dca8-4cfa-bf7f-65a5bfe5659f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:07.168785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-78289354-dca8-4cfa-bf7f-65a5bfe5659f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:07.174028 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c266af45-3f20-4184-86bd-016c160ef3aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:07.175205 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c266af45-3f20-4184-86bd-016c160ef3aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:07.175349 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78289354-dca8-4cfa-bf7f-65a5bfe5659f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:07.175735 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78289354-dca8-4cfa-bf7f-65a5bfe5659f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:07.176492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78289354-dca8-4cfa-bf7f-65a5bfe5659f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:07.176924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78289354-dca8-4cfa-bf7f-65a5bfe5659f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:07.181560 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c266af45-3f20-4184-86bd-016c160ef3aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:07.182010 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c266af45-3f20-4184-86bd-016c160ef3aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:07.182806 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c266af45-3f20-4184-86bd-016c160ef3aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:07.183244 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c266af45-3f20-4184-86bd-016c160ef3aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:07.261489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c266af45-3f20-4184-86bd-016c160ef3aa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 30181 microversion: 2.20 time: 0.091358 Aug 30 07:58:07.262185 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 644/1336] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:07 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 30181 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:07.300789 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-78289354-dca8-4cfa-bf7f-65a5bfe5659f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:07.308070 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-78289354-dca8-4cfa-bf7f-65a5bfe5659f tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1555 microversion: 2.1 time: 0.144110 Aug 30 07:58:07.308630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 693/1337] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:58:07 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1555 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:58:07.459505 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cdf657fb-585a-4149-87ac-393f8f800042 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:07.460501 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-cdf657fb-585a-4149-87ac-393f8f800042 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:07.467009 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cdf657fb-585a-4149-87ac-393f8f800042 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:07.467451 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cdf657fb-585a-4149-87ac-393f8f800042 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:07.468206 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cdf657fb-585a-4149-87ac-393f8f800042 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:07.468630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cdf657fb-585a-4149-87ac-393f8f800042 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:07.531601 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-cdf657fb-585a-4149-87ac-393f8f800042 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.075837 Aug 30 07:58:07.532135 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 645/1338] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:07 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:08.273745 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-21ca07c3-a8e5-4784-b1d5-5a80941fbbb1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:08.274678 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-21ca07c3-a8e5-4784-b1d5-5a80941fbbb1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:08.281615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21ca07c3-a8e5-4784-b1d5-5a80941fbbb1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:08.282057 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21ca07c3-a8e5-4784-b1d5-5a80941fbbb1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:08.282846 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21ca07c3-a8e5-4784-b1d5-5a80941fbbb1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:08.283272 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21ca07c3-a8e5-4784-b1d5-5a80941fbbb1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:08.325161 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b49803a2-a94b-4f2b-9f89-3c9c3243e5e9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:08.325902 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b49803a2-a94b-4f2b-9f89-3c9c3243e5e9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:08.333417 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b49803a2-a94b-4f2b-9f89-3c9c3243e5e9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:08.333871 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b49803a2-a94b-4f2b-9f89-3c9c3243e5e9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:08.334689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b49803a2-a94b-4f2b-9f89-3c9c3243e5e9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:08.335132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b49803a2-a94b-4f2b-9f89-3c9c3243e5e9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:08.359145 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-21ca07c3-a8e5-4784-b1d5-5a80941fbbb1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 32002 microversion: 2.20 time: 0.088725 Aug 30 07:58:08.360147 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 694/1339] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:08 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 32002 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:08.535936 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b49803a2-a94b-4f2b-9f89-3c9c3243e5e9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b351a2f80c7840ddae631ef1431251c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16062b13b0c4cd2be8f26f9e093d9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:08.543299 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b49803a2-a94b-4f2b-9f89-3c9c3243e5e9 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 200 len: 1555 microversion: 2.1 time: 0.222216 Aug 30 07:58:08.543482 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1ceefcf7-769d-42b3-a178-4f56bc30a734 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:08.543862 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 646/1340] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:58:08 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:58:08.544490 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1ceefcf7-769d-42b3-a178-4f56bc30a734 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:08.551037 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1ceefcf7-769d-42b3-a178-4f56bc30a734 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:08.551494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1ceefcf7-769d-42b3-a178-4f56bc30a734 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:08.552271 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1ceefcf7-769d-42b3-a178-4f56bc30a734 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:08.552712 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1ceefcf7-769d-42b3-a178-4f56bc30a734 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:08.617347 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1ceefcf7-769d-42b3-a178-4f56bc30a734 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.077428 Aug 30 07:58:08.618250 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 695/1341] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:08 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:08.685799 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-01b2854a-7089-4c17-b950-5feb2da4c724 req-f372ae0f-e1e1-434c-9411-d21f07271551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35", "name": "network-vif-deleted", "tag": "17a5b7fe-6ea4-4a61-995f-35648fa60831"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:08.688559 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:58:08.688559 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:58:08.698453 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-01b2854a-7089-4c17-b950-5feb2da4c724 req-f372ae0f-e1e1-434c-9411-d21f07271551 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:08.698890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-01b2854a-7089-4c17-b950-5feb2da4c724 req-f372ae0f-e1e1-434c-9411-d21f07271551 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:08.712341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-01b2854a-7089-4c17-b950-5feb2da4c724 req-f372ae0f-e1e1-434c-9411-d21f07271551 service nova] Creating event network-vif-deleted:17a5b7fe-6ea4-4a61-995f-35648fa60831 for instance c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 on hv-cinder-80619 Aug 30 07:58:08.717162 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-01b2854a-7089-4c17-b950-5feb2da4c724 req-f372ae0f-e1e1-434c-9411-d21f07271551 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035139 Aug 30 07:58:08.717777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 647/1342] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:58:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:58:09.371600 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e48624f7-1df9-43d9-ba21-c6bb7675649c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:09.372667 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e48624f7-1df9-43d9-ba21-c6bb7675649c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:09.379916 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e48624f7-1df9-43d9-ba21-c6bb7675649c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:09.380363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e48624f7-1df9-43d9-ba21-c6bb7675649c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:09.381125 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e48624f7-1df9-43d9-ba21-c6bb7675649c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:09.381558 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e48624f7-1df9-43d9-ba21-c6bb7675649c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:09.454861 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e48624f7-1df9-43d9-ba21-c6bb7675649c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 33295 microversion: 2.20 time: 0.087373 Aug 30 07:58:09.455506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 696/1343] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:09 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 33295 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:09.560562 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-22200ab1-f769-42c2-89f6-c38ce8f69fe7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:09.561750 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-22200ab1-f769-42c2-89f6-c38ce8f69fe7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] [instance: c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:09.568258 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-22200ab1-f769-42c2-89f6-c38ce8f69fe7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:09.568735 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-22200ab1-f769-42c2-89f6-c38ce8f69fe7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:09.569495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-22200ab1-f769-42c2-89f6-c38ce8f69fe7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:09.569935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-22200ab1-f769-42c2-89f6-c38ce8f69fe7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:09.583351 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-22200ab1-f769-42c2-89f6-c38ce8f69fe7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] HTTP exception thrown: Instance c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 could not be found. Aug 30 07:58:09.583931 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-22200ab1-f769-42c2-89f6-c38ce8f69fe7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Returning 404 to user: Instance c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:58:09.584740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-22200ab1-f769-42c2-89f6-c38ce8f69fe7 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35" status: 404 len: 111 microversion: 2.1 time: 0.028251 Aug 30 07:58:09.585252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 648/1344] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:58:09 2021] GET /compute/v2.1/servers/c6faa4c8-ee7d-46fa-9e59-5682a4e5bd35 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:58:09.593707 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8f0242bf-500d-4aa9-962b-42984b7dc1d2 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] Calling method '.version_select at 0x7f341c066280>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:09.612334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8f0242bf-500d-4aa9-962b-42984b7dc1d2 tempest-TestMinimumBasicScenario-1811508852 tempest-TestMinimumBasicScenario-1811508852-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1899802726" status: 202 len: 0 microversion: 2.1 time: 0.022700 Aug 30 07:58:09.612885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 697/1345] 10.222.0.73 () {58 vars in 1272 bytes} [Mon Aug 30 07:58:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1899802726 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:09.628839 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-65c34508-61b0-417e-ad94-1499f11998f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:09.629678 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-65c34508-61b0-417e-ad94-1499f11998f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:09.635382 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65c34508-61b0-417e-ad94-1499f11998f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:09.635829 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65c34508-61b0-417e-ad94-1499f11998f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:09.636582 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65c34508-61b0-417e-ad94-1499f11998f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:09.637121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-65c34508-61b0-417e-ad94-1499f11998f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:09.698573 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-65c34508-61b0-417e-ad94-1499f11998f5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.073151 Aug 30 07:58:09.702796 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 649/1346] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:09 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:10.469127 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fdaee1da-69f0-4688-8bb6-2390c67e6074 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:10.470553 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fdaee1da-69f0-4688-8bb6-2390c67e6074 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:10.477133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fdaee1da-69f0-4688-8bb6-2390c67e6074 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:10.477575 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fdaee1da-69f0-4688-8bb6-2390c67e6074 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:10.478365 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fdaee1da-69f0-4688-8bb6-2390c67e6074 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:10.478796 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fdaee1da-69f0-4688-8bb6-2390c67e6074 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:10.569662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fdaee1da-69f0-4688-8bb6-2390c67e6074 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 34318 microversion: 2.20 time: 0.106075 Aug 30 07:58:10.570319 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 698/1347] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:10 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 34318 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:10.710967 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-71b56b75-4c91-4847-84d9-a17e282b49fd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:10.711948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-71b56b75-4c91-4847-84d9-a17e282b49fd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:10.718447 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-71b56b75-4c91-4847-84d9-a17e282b49fd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:10.718892 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-71b56b75-4c91-4847-84d9-a17e282b49fd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:10.719654 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-71b56b75-4c91-4847-84d9-a17e282b49fd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:10.720083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-71b56b75-4c91-4847-84d9-a17e282b49fd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:10.781427 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-71b56b75-4c91-4847-84d9-a17e282b49fd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.074367 Aug 30 07:58:10.782099 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 650/1348] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:10 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:11.581822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a6da307b-f99d-4bb2-8cb9-8b1ccb4b4b7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:11.582865 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a6da307b-f99d-4bb2-8cb9-8b1ccb4b4b7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:11.589290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a6da307b-f99d-4bb2-8cb9-8b1ccb4b4b7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:11.589744 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a6da307b-f99d-4bb2-8cb9-8b1ccb4b4b7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:11.590567 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a6da307b-f99d-4bb2-8cb9-8b1ccb4b4b7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:11.591003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a6da307b-f99d-4bb2-8cb9-8b1ccb4b4b7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:11.683613 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a6da307b-f99d-4bb2-8cb9-8b1ccb4b4b7e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 35521 microversion: 2.20 time: 0.106130 Aug 30 07:58:11.684263 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 699/1349] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:11 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 35521 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:11.793300 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d681db68-71ba-430f-8f6f-a1515727f03e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:11.794479 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d681db68-71ba-430f-8f6f-a1515727f03e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:11.802041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d681db68-71ba-430f-8f6f-a1515727f03e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:11.802526 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d681db68-71ba-430f-8f6f-a1515727f03e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:11.803307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d681db68-71ba-430f-8f6f-a1515727f03e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:11.803745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d681db68-71ba-430f-8f6f-a1515727f03e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:11.882372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d681db68-71ba-430f-8f6f-a1515727f03e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.092829 Aug 30 07:58:11.883583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 651/1350] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:11 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:12.696019 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-af6ad014-e9ea-4920-9550-1b8f9353c766 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:12.697020 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-af6ad014-e9ea-4920-9550-1b8f9353c766 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:12.703433 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af6ad014-e9ea-4920-9550-1b8f9353c766 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:12.703878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af6ad014-e9ea-4920-9550-1b8f9353c766 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:12.704637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af6ad014-e9ea-4920-9550-1b8f9353c766 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:12.705074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-af6ad014-e9ea-4920-9550-1b8f9353c766 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:12.779101 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-af6ad014-e9ea-4920-9550-1b8f9353c766 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 37037 microversion: 2.20 time: 0.086978 Aug 30 07:58:12.780134 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 700/1351] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:12 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 37037 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:12.896951 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-63cdad79-d32e-4ae9-b386-3ff312cb6e83 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:12.897944 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-63cdad79-d32e-4ae9-b386-3ff312cb6e83 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:12.904480 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-63cdad79-d32e-4ae9-b386-3ff312cb6e83 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:12.905573 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-63cdad79-d32e-4ae9-b386-3ff312cb6e83 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:12.906258 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-63cdad79-d32e-4ae9-b386-3ff312cb6e83 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:12.906872 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-63cdad79-d32e-4ae9-b386-3ff312cb6e83 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:12.984918 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-63cdad79-d32e-4ae9-b386-3ff312cb6e83 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.091689 Aug 30 07:58:12.986834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 652/1352] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:12 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:13.791982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a58f8309-159f-4a14-b698-3d6ea3591d00 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:13.792955 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a58f8309-159f-4a14-b698-3d6ea3591d00 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:13.800089 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a58f8309-159f-4a14-b698-3d6ea3591d00 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:13.800552 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a58f8309-159f-4a14-b698-3d6ea3591d00 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:13.801300 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a58f8309-159f-4a14-b698-3d6ea3591d00 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:13.801734 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a58f8309-159f-4a14-b698-3d6ea3591d00 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:13.870837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a58f8309-159f-4a14-b698-3d6ea3591d00 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 38184 microversion: 2.20 time: 0.082786 Aug 30 07:58:13.875570 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 701/1353] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:13 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 38184 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:13.997045 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-67067623-1ecf-4f79-96bf-07f98446b3f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:13.998044 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-67067623-1ecf-4f79-96bf-07f98446b3f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:14.004486 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-67067623-1ecf-4f79-96bf-07f98446b3f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:14.004935 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-67067623-1ecf-4f79-96bf-07f98446b3f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:14.005702 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-67067623-1ecf-4f79-96bf-07f98446b3f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:14.006135 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-67067623-1ecf-4f79-96bf-07f98446b3f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:14.068696 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-67067623-1ecf-4f79-96bf-07f98446b3f9 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 28749 microversion: 2.1 time: 0.074573 Aug 30 07:58:14.072560 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 653/1354] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:13 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 28749 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:14.883541 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-924f1a84-6b81-435e-a953-8c37870b7aa3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:14.884807 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-924f1a84-6b81-435e-a953-8c37870b7aa3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:14.891682 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-924f1a84-6b81-435e-a953-8c37870b7aa3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:14.892193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-924f1a84-6b81-435e-a953-8c37870b7aa3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:14.893257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-924f1a84-6b81-435e-a953-8c37870b7aa3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:14.893864 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-924f1a84-6b81-435e-a953-8c37870b7aa3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:14.954721 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-924f1a84-6b81-435e-a953-8c37870b7aa3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 38184 microversion: 2.20 time: 0.075007 Aug 30 07:58:14.968987 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 702/1355] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:14 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 38184 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:15.081436 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ab4af36a-6d14-47e1-b308-5976aa67426b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:15.082473 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ab4af36a-6d14-47e1-b308-5976aa67426b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:15.088998 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab4af36a-6d14-47e1-b308-5976aa67426b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:15.089453 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab4af36a-6d14-47e1-b308-5976aa67426b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:15.090337 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab4af36a-6d14-47e1-b308-5976aa67426b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:15.090783 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ab4af36a-6d14-47e1-b308-5976aa67426b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:15.175668 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ab4af36a-6d14-47e1-b308-5976aa67426b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 29083 microversion: 2.1 time: 0.098825 Aug 30 07:58:15.176768 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 654/1356] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:15 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 29083 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:15.984211 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-25005385-82c1-4908-a04f-bd5ec39efcbd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:15.995383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-25005385-82c1-4908-a04f-bd5ec39efcbd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:16.009216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-25005385-82c1-4908-a04f-bd5ec39efcbd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:16.009662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-25005385-82c1-4908-a04f-bd5ec39efcbd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:16.010513 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-25005385-82c1-4908-a04f-bd5ec39efcbd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:16.011054 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-25005385-82c1-4908-a04f-bd5ec39efcbd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:16.082794 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-25005385-82c1-4908-a04f-bd5ec39efcbd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 38184 microversion: 2.20 time: 0.105727 Aug 30 07:58:16.083733 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 703/1357] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:15 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 38184 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:16.188824 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d1b7cd9b-a513-4fb7-b389-2209691d7e5c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:16.190777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d1b7cd9b-a513-4fb7-b389-2209691d7e5c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:16.197501 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1b7cd9b-a513-4fb7-b389-2209691d7e5c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:16.197961 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1b7cd9b-a513-4fb7-b389-2209691d7e5c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:16.198772 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1b7cd9b-a513-4fb7-b389-2209691d7e5c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:16.199215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d1b7cd9b-a513-4fb7-b389-2209691d7e5c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:16.287283 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d1b7cd9b-a513-4fb7-b389-2209691d7e5c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 31082 microversion: 2.1 time: 0.103120 Aug 30 07:58:16.289061 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 655/1358] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:16 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 31082 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:58:17.094653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fc1c4ecd-2cd0-4b9f-a4b9-e3906fcf8d68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:17.095653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fc1c4ecd-2cd0-4b9f-a4b9-e3906fcf8d68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:17.102231 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc1c4ecd-2cd0-4b9f-a4b9-e3906fcf8d68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:17.102678 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc1c4ecd-2cd0-4b9f-a4b9-e3906fcf8d68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:17.103435 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc1c4ecd-2cd0-4b9f-a4b9-e3906fcf8d68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:17.103873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc1c4ecd-2cd0-4b9f-a4b9-e3906fcf8d68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:17.164734 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fc1c4ecd-2cd0-4b9f-a4b9-e3906fcf8d68 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 38184 microversion: 2.20 time: 0.074170 Aug 30 07:58:17.165434 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 704/1359] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:17 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 38184 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:17.300571 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2639b97f-f8a8-4025-90cd-c3b29651527a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:17.301519 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2639b97f-f8a8-4025-90cd-c3b29651527a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:17.307873 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2639b97f-f8a8-4025-90cd-c3b29651527a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:17.308321 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2639b97f-f8a8-4025-90cd-c3b29651527a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:17.309088 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2639b97f-f8a8-4025-90cd-c3b29651527a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:17.309522 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2639b97f-f8a8-4025-90cd-c3b29651527a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:17.384827 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2639b97f-f8a8-4025-90cd-c3b29651527a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 32912 microversion: 2.1 time: 0.089185 Aug 30 07:58:17.388981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 656/1360] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:17 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 32912 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:18.177852 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c0ae13dc-ab21-45d3-8198-971c949cabf7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:18.178959 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c0ae13dc-ab21-45d3-8198-971c949cabf7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:18.186375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c0ae13dc-ab21-45d3-8198-971c949cabf7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:18.186825 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c0ae13dc-ab21-45d3-8198-971c949cabf7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:18.187587 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c0ae13dc-ab21-45d3-8198-971c949cabf7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:18.188018 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c0ae13dc-ab21-45d3-8198-971c949cabf7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:18.255957 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c0ae13dc-ab21-45d3-8198-971c949cabf7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 200 len: 38327 microversion: 2.20 time: 0.081783 Aug 30 07:58:18.257081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 705/1361] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:18 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 38327 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:58:18.267526 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e3ad56fd-f996-4ce4-9085-77bd052446cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:18.268240 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e3ad56fd-f996-4ce4-9085-77bd052446cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:18.275476 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3ad56fd-f996-4ce4-9085-77bd052446cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:18.276042 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3ad56fd-f996-4ce4-9085-77bd052446cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:18.276877 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3ad56fd-f996-4ce4-9085-77bd052446cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:18.277379 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3ad56fd-f996-4ce4-9085-77bd052446cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:18.304727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e3ad56fd-f996-4ce4-9085-77bd052446cd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/ips" status: 200 len: 151 microversion: 2.20 time: 0.041672 Aug 30 07:58:18.305722 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 657/1362] 10.222.0.73 () {60 vars in 1289 bytes} [Mon Aug 30 07:58:18 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:58:18.401945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cb452d6f-9c24-4e6a-b49f-10ea3bd9f614 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:18.404110 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cb452d6f-9c24-4e6a-b49f-10ea3bd9f614 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:18.413562 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cb452d6f-9c24-4e6a-b49f-10ea3bd9f614 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:18.414352 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cb452d6f-9c24-4e6a-b49f-10ea3bd9f614 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:18.415546 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cb452d6f-9c24-4e6a-b49f-10ea3bd9f614 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:18.416202 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cb452d6f-9c24-4e6a-b49f-10ea3bd9f614 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:18.504700 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cb452d6f-9c24-4e6a-b49f-10ea3bd9f614 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 33917 microversion: 2.1 time: 0.111100 Aug 30 07:58:18.509315 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 706/1363] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:18 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 33917 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:19.518764 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-61c2e49a-f670-426a-8a3b-eb01a66da4dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:19.520758 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-61c2e49a-f670-426a-8a3b-eb01a66da4dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:19.534902 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61c2e49a-f670-426a-8a3b-eb01a66da4dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:19.535362 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61c2e49a-f670-426a-8a3b-eb01a66da4dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:19.536307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61c2e49a-f670-426a-8a3b-eb01a66da4dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:19.536745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-61c2e49a-f670-426a-8a3b-eb01a66da4dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:19.627307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-61c2e49a-f670-426a-8a3b-eb01a66da4dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 35189 microversion: 2.1 time: 0.114218 Aug 30 07:58:19.627957 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 658/1364] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:19 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 35189 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:20.536663 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-43389b8a-6000-42c8-b25d-e2206ce926d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:20.538216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-43389b8a-6000-42c8-b25d-e2206ce926d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:20.546000 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-43389b8a-6000-42c8-b25d-e2206ce926d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:20.546895 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-43389b8a-6000-42c8-b25d-e2206ce926d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:20.548316 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-43389b8a-6000-42c8-b25d-e2206ce926d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:20.548965 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-43389b8a-6000-42c8-b25d-e2206ce926d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:20.640255 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f058a4dc-3cae-4d08-ba36-d11e361c7544 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:20.641359 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f058a4dc-3cae-4d08-ba36-d11e361c7544 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:20.657521 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f058a4dc-3cae-4d08-ba36-d11e361c7544 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:20.658197 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f058a4dc-3cae-4d08-ba36-d11e361c7544 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:20.658948 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f058a4dc-3cae-4d08-ba36-d11e361c7544 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:20.659583 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f058a4dc-3cae-4d08-ba36-d11e361c7544 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:20.753031 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f058a4dc-3cae-4d08-ba36-d11e361c7544 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 36379 microversion: 2.1 time: 0.117283 Aug 30 07:58:20.755412 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 659/1365] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:20 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 36379 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:20.766171 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-43389b8a-6000-42c8-b25d-e2206ce926d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lazy-loading 'flavor' on Instance uuid 04bba115-ffa4-48f5-9f97-30c8117579c2 {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:58:21.044473 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-43389b8a-6000-42c8-b25d-e2206ce926d0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 202 len: 0 microversion: 2.20 time: 0.512052 Aug 30 07:58:21.045958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 707/1366] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:20 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:58:21.056470 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c0820984-d17a-4e20-b3b0-734fc77718b8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:21.057402 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c0820984-d17a-4e20-b3b0-734fc77718b8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:21.068232 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0820984-d17a-4e20-b3b0-734fc77718b8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:21.068686 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0820984-d17a-4e20-b3b0-734fc77718b8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:21.069461 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0820984-d17a-4e20-b3b0-734fc77718b8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:21.070059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0820984-d17a-4e20-b3b0-734fc77718b8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:21.206631 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c0820984-d17a-4e20-b3b0-734fc77718b8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:21.214930 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c0820984-d17a-4e20-b3b0-734fc77718b8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:21.216549 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c0820984-d17a-4e20-b3b0-734fc77718b8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:21.218334 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c0820984-d17a-4e20-b3b0-734fc77718b8 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.165821 Aug 30 07:58:21.218954 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 660/1367] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:21 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:21.765990 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5984c67c-3dac-449d-86c9-cb0317e364d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:21.767317 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5984c67c-3dac-449d-86c9-cb0317e364d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:21.774668 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5984c67c-3dac-449d-86c9-cb0317e364d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:21.775803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5984c67c-3dac-449d-86c9-cb0317e364d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:21.776743 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5984c67c-3dac-449d-86c9-cb0317e364d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:21.777240 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5984c67c-3dac-449d-86c9-cb0317e364d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:21.879751 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5984c67c-3dac-449d-86c9-cb0317e364d1 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 37976 microversion: 2.1 time: 0.117486 Aug 30 07:58:21.884669 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 708/1368] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:21 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 37976 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:22.237190 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b9585cbc-7729-46ba-afd2-e5f4093eed5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:22.237806 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b9585cbc-7729-46ba-afd2-e5f4093eed5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:22.244250 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b9585cbc-7729-46ba-afd2-e5f4093eed5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:22.244926 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b9585cbc-7729-46ba-afd2-e5f4093eed5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:22.245975 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b9585cbc-7729-46ba-afd2-e5f4093eed5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:22.246556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b9585cbc-7729-46ba-afd2-e5f4093eed5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:22.401282 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b9585cbc-7729-46ba-afd2-e5f4093eed5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:22.409348 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b9585cbc-7729-46ba-afd2-e5f4093eed5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:22.415211 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b9585cbc-7729-46ba-afd2-e5f4093eed5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:22.416413 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b9585cbc-7729-46ba-afd2-e5f4093eed5f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.183045 Aug 30 07:58:22.417491 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 661/1369] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:22 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:22.893455 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4d3fc0a5-da73-44fb-9787-e75415c0a1ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:22.907611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4d3fc0a5-da73-44fb-9787-e75415c0a1ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:22.915682 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d3fc0a5-da73-44fb-9787-e75415c0a1ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:22.916323 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d3fc0a5-da73-44fb-9787-e75415c0a1ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:22.917295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d3fc0a5-da73-44fb-9787-e75415c0a1ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:22.917882 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4d3fc0a5-da73-44fb-9787-e75415c0a1ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:22.991202 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4d3fc0a5-da73-44fb-9787-e75415c0a1ca tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 38279 microversion: 2.1 time: 0.102703 Aug 30 07:58:22.992650 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 709/1370] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:22 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 38279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:23.435980 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c903799f-108d-4dbe-824c-90c1e48a04ee tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:23.436584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c903799f-108d-4dbe-824c-90c1e48a04ee tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:23.442747 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c903799f-108d-4dbe-824c-90c1e48a04ee tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:23.443191 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c903799f-108d-4dbe-824c-90c1e48a04ee tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:23.443947 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c903799f-108d-4dbe-824c-90c1e48a04ee tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:23.444376 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c903799f-108d-4dbe-824c-90c1e48a04ee tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:23.592093 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c903799f-108d-4dbe-824c-90c1e48a04ee tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:23.602071 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c903799f-108d-4dbe-824c-90c1e48a04ee tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:23.603999 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c903799f-108d-4dbe-824c-90c1e48a04ee tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:23.605503 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c903799f-108d-4dbe-824c-90c1e48a04ee tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.173883 Aug 30 07:58:23.606286 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 662/1371] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:23 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:24.004915 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6d1db1b2-8500-4a05-bca9-94d9ff2023ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:24.006075 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6d1db1b2-8500-4a05-bca9-94d9ff2023ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:24.013936 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d1db1b2-8500-4a05-bca9-94d9ff2023ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:24.019446 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d1db1b2-8500-4a05-bca9-94d9ff2023ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:24.020874 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d1db1b2-8500-4a05-bca9-94d9ff2023ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:24.021567 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d1db1b2-8500-4a05-bca9-94d9ff2023ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:24.098357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6d1db1b2-8500-4a05-bca9-94d9ff2023ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 38279 microversion: 2.1 time: 0.097173 Aug 30 07:58:24.103622 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 710/1372] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:23 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 38279 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:24.625569 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-de3ea55f-18c3-4fa0-8ff5-5a50b133ad4e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:24.626466 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-de3ea55f-18c3-4fa0-8ff5-5a50b133ad4e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:24.632610 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de3ea55f-18c3-4fa0-8ff5-5a50b133ad4e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:24.633054 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de3ea55f-18c3-4fa0-8ff5-5a50b133ad4e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:24.634394 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de3ea55f-18c3-4fa0-8ff5-5a50b133ad4e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:24.634831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-de3ea55f-18c3-4fa0-8ff5-5a50b133ad4e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:24.774772 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-de3ea55f-18c3-4fa0-8ff5-5a50b133ad4e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:24.783823 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-de3ea55f-18c3-4fa0-8ff5-5a50b133ad4e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:24.786021 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-de3ea55f-18c3-4fa0-8ff5-5a50b133ad4e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:24.789167 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-de3ea55f-18c3-4fa0-8ff5-5a50b133ad4e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.168282 Aug 30 07:58:24.790446 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 663/1373] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:24 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:25.112838 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f404f587-72ec-4a11-ac41-09fd7b5f65dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:25.116121 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f404f587-72ec-4a11-ac41-09fd7b5f65dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:25.127209 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f404f587-72ec-4a11-ac41-09fd7b5f65dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:25.127985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f404f587-72ec-4a11-ac41-09fd7b5f65dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:25.129462 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f404f587-72ec-4a11-ac41-09fd7b5f65dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:25.130834 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f404f587-72ec-4a11-ac41-09fd7b5f65dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:25.225113 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f404f587-72ec-4a11-ac41-09fd7b5f65dd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 38279 microversion: 2.1 time: 0.116703 Aug 30 07:58:25.225880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 711/1374] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:25 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 38279 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:25.808121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f2514dd1-7767-4e19-bbc5-7e6686195cce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:25.809569 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f2514dd1-7767-4e19-bbc5-7e6686195cce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:25.817219 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2514dd1-7767-4e19-bbc5-7e6686195cce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:25.817917 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2514dd1-7767-4e19-bbc5-7e6686195cce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:25.818895 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2514dd1-7767-4e19-bbc5-7e6686195cce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:25.819694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2514dd1-7767-4e19-bbc5-7e6686195cce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:26.066692 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f2514dd1-7767-4e19-bbc5-7e6686195cce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:26.077101 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f2514dd1-7767-4e19-bbc5-7e6686195cce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:26.083270 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f2514dd1-7767-4e19-bbc5-7e6686195cce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:26.085550 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f2514dd1-7767-4e19-bbc5-7e6686195cce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.281163 Aug 30 07:58:26.086642 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 664/1375] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:25 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:26.237505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f009c8db-9b0a-4b78-82f1-cad7f2b0c0d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:26.239066 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f009c8db-9b0a-4b78-82f1-cad7f2b0c0d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:26.249630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f009c8db-9b0a-4b78-82f1-cad7f2b0c0d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:26.250081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f009c8db-9b0a-4b78-82f1-cad7f2b0c0d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:26.251038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f009c8db-9b0a-4b78-82f1-cad7f2b0c0d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:26.251478 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f009c8db-9b0a-4b78-82f1-cad7f2b0c0d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:26.366189 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f009c8db-9b0a-4b78-82f1-cad7f2b0c0d8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action" status: 200 len: 38408 microversion: 2.1 time: 0.132520 Aug 30 07:58:26.371582 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 712/1376] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 07:58:26 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/action => generated 38408 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 07:58:26.378265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-480bd8c8-567e-4152-8c47-f3639bb5e52d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:26.379233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-480bd8c8-567e-4152-8c47-f3639bb5e52d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:26.389553 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-480bd8c8-567e-4152-8c47-f3639bb5e52d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:26.392089 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-480bd8c8-567e-4152-8c47-f3639bb5e52d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:26.392993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-480bd8c8-567e-4152-8c47-f3639bb5e52d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:26.394681 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-480bd8c8-567e-4152-8c47-f3639bb5e52d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:26.439994 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-480bd8c8-567e-4152-8c47-f3639bb5e52d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/ips" status: 200 len: 145 microversion: 2.1 time: 0.066134 Aug 30 07:58:26.440844 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 665/1377] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 30 07:58:26 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/ips => generated 145 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:58:27.104513 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6ee2e255-caa1-4b89-a038-bd39fbcdea9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:27.105413 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6ee2e255-caa1-4b89-a038-bd39fbcdea9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:27.113822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ee2e255-caa1-4b89-a038-bd39fbcdea9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:27.114291 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ee2e255-caa1-4b89-a038-bd39fbcdea9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:27.115059 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ee2e255-caa1-4b89-a038-bd39fbcdea9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:27.115657 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ee2e255-caa1-4b89-a038-bd39fbcdea9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:27.260194 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6ee2e255-caa1-4b89-a038-bd39fbcdea9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:27.268745 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6ee2e255-caa1-4b89-a038-bd39fbcdea9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:27.270525 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6ee2e255-caa1-4b89-a038-bd39fbcdea9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:27.271684 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6ee2e255-caa1-4b89-a038-bd39fbcdea9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.171666 Aug 30 07:58:27.272232 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 713/1378] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:27 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:27.424115 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bbd21c58-2381-4b08-98b9-5c6751943675 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Action: 'create', calling method: .version_select at 0x7f341c0ec430>, body: {"keypair": {"name": "tempest-TestShelveInstance-763817541"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:27.441876 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-bbd21c58-2381-4b08-98b9-5c6751943675 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Getting quotas for project 3748b4459c5b4b0eb1eae5f1a86e1d28. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:58:27.445676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-bbd21c58-2381-4b08-98b9-5c6751943675 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Getting quotas for user d2a305429eb64d259972aae774b6d7bc and project 3748b4459c5b4b0eb1eae5f1a86e1d28. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:58:27.830659 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e6d3c121-6269-4ce5-b8eb-1cf713745496 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bd7f203-77c6-4aa2-97b9-dd25d97c045e"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:27.831725 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e6d3c121-6269-4ce5-b8eb-1cf713745496 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:27.838497 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6d3c121-6269-4ce5-b8eb-1cf713745496 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:27.839194 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6d3c121-6269-4ce5-b8eb-1cf713745496 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:27.840130 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6d3c121-6269-4ce5-b8eb-1cf713745496 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:27.840724 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6d3c121-6269-4ce5-b8eb-1cf713745496 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:27.967548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-bbd21c58-2381-4b08-98b9-5c6751943675 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Getting quotas for project 3748b4459c5b4b0eb1eae5f1a86e1d28. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:58:27.971027 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-bbd21c58-2381-4b08-98b9-5c6751943675 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Getting quotas for user d2a305429eb64d259972aae774b6d7bc and project 3748b4459c5b4b0eb1eae5f1a86e1d28. Resources: {'key_pairs'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:58:27.984915 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bbd21c58-2381-4b08-98b9-5c6751943675 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.756938 Aug 30 07:58:27.985505 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 666/1379] 10.222.0.73 () {60 vars in 1158 bytes} [Mon Aug 30 07:58:27 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:58:28.105354 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e6d3c121-6269-4ce5-b8eb-1cf713745496 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279580 Aug 30 07:58:28.105958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 714/1380] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:58:27 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:58:28.290241 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-16571091-941f-4b23-814f-4431fa653e26 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:28.290973 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-16571091-941f-4b23-814f-4431fa653e26 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:28.298058 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-16571091-941f-4b23-814f-4431fa653e26 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:28.298787 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-16571091-941f-4b23-814f-4431fa653e26 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:28.299589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-16571091-941f-4b23-814f-4431fa653e26 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:28.300126 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-16571091-941f-4b23-814f-4431fa653e26 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:28.433644 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-16571091-941f-4b23-814f-4431fa653e26 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:28.457142 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-16571091-941f-4b23-814f-4431fa653e26 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:28.458702 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-16571091-941f-4b23-814f-4431fa653e26 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:28.460372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-16571091-941f-4b23-814f-4431fa653e26 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.173912 Aug 30 07:58:28.462205 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 667/1381] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:28 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:29.480874 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7caa8ece-25f3-40fe-88e2-e1a439461f97 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:29.481868 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7caa8ece-25f3-40fe-88e2-e1a439461f97 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:29.488901 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7caa8ece-25f3-40fe-88e2-e1a439461f97 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:29.489344 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7caa8ece-25f3-40fe-88e2-e1a439461f97 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:29.490106 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7caa8ece-25f3-40fe-88e2-e1a439461f97 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:29.490583 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7caa8ece-25f3-40fe-88e2-e1a439461f97 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:29.630393 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7caa8ece-25f3-40fe-88e2-e1a439461f97 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:29.640854 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7caa8ece-25f3-40fe-88e2-e1a439461f97 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:29.642473 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7caa8ece-25f3-40fe-88e2-e1a439461f97 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:29.643898 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7caa8ece-25f3-40fe-88e2-e1a439461f97 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.167778 Aug 30 07:58:29.644442 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 715/1382] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:29 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:30.663331 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9841744a-9ab4-4f23-95bd-36147c4c577f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:30.663813 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9841744a-9ab4-4f23-95bd-36147c4c577f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:30.672075 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9841744a-9ab4-4f23-95bd-36147c4c577f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:30.672532 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9841744a-9ab4-4f23-95bd-36147c4c577f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:30.673534 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9841744a-9ab4-4f23-95bd-36147c4c577f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:30.673982 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9841744a-9ab4-4f23-95bd-36147c4c577f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:30.808108 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9841744a-9ab4-4f23-95bd-36147c4c577f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:30.816632 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9841744a-9ab4-4f23-95bd-36147c4c577f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:30.818630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9841744a-9ab4-4f23-95bd-36147c4c577f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:30.819933 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9841744a-9ab4-4f23-95bd-36147c4c577f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.160982 Aug 30 07:58:30.820614 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 668/1383] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:30 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:31.839287 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a035a7e1-6a60-479b-90c7-02fa9b59922b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:31.839901 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a035a7e1-6a60-479b-90c7-02fa9b59922b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:31.847386 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a035a7e1-6a60-479b-90c7-02fa9b59922b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:31.848094 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a035a7e1-6a60-479b-90c7-02fa9b59922b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:31.848863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a035a7e1-6a60-479b-90c7-02fa9b59922b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:31.849291 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a035a7e1-6a60-479b-90c7-02fa9b59922b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:31.974166 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a035a7e1-6a60-479b-90c7-02fa9b59922b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:31.982770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a035a7e1-6a60-479b-90c7-02fa9b59922b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:31.984298 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a035a7e1-6a60-479b-90c7-02fa9b59922b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:31.985464 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a035a7e1-6a60-479b-90c7-02fa9b59922b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.149873 Aug 30 07:58:31.986018 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 716/1384] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:31 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:58:33.004531 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-71db1321-ddf8-4780-be62-af3d5396ed89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:33.005141 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-71db1321-ddf8-4780-be62-af3d5396ed89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:33.011074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-71db1321-ddf8-4780-be62-af3d5396ed89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:33.011519 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-71db1321-ddf8-4780-be62-af3d5396ed89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:33.012272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-71db1321-ddf8-4780-be62-af3d5396ed89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:33.013205 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-71db1321-ddf8-4780-be62-af3d5396ed89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:33.141495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-71db1321-ddf8-4780-be62-af3d5396ed89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:33.149987 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-71db1321-ddf8-4780-be62-af3d5396ed89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:33.151493 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-71db1321-ddf8-4780-be62-af3d5396ed89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:33.152634 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-71db1321-ddf8-4780-be62-af3d5396ed89 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1745 microversion: 2.20 time: 0.151852 Aug 30 07:58:33.153190 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 669/1385] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:32 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:34.170958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d9d161bc-6482-454d-aa15-bfc2b0aa46dd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:34.171564 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d9d161bc-6482-454d-aa15-bfc2b0aa46dd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:34.177340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9d161bc-6482-454d-aa15-bfc2b0aa46dd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:34.177785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9d161bc-6482-454d-aa15-bfc2b0aa46dd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:34.178573 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9d161bc-6482-454d-aa15-bfc2b0aa46dd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:34.179009 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d9d161bc-6482-454d-aa15-bfc2b0aa46dd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:34.307374 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d9d161bc-6482-454d-aa15-bfc2b0aa46dd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:34.317186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d9d161bc-6482-454d-aa15-bfc2b0aa46dd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:34.318726 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d9d161bc-6482-454d-aa15-bfc2b0aa46dd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:34.319883 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d9d161bc-6482-454d-aa15-bfc2b0aa46dd tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1745 microversion: 2.20 time: 0.152658 Aug 30 07:58:34.320446 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 717/1386] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:34 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:35.340298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-07f9fc7c-207c-4027-b626-2670ef407366 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:35.341474 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-07f9fc7c-207c-4027-b626-2670ef407366 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:35.348588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-07f9fc7c-207c-4027-b626-2670ef407366 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:35.349039 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-07f9fc7c-207c-4027-b626-2670ef407366 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:35.350170 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-07f9fc7c-207c-4027-b626-2670ef407366 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:35.350608 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-07f9fc7c-207c-4027-b626-2670ef407366 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:35.474488 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-07f9fc7c-207c-4027-b626-2670ef407366 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:35.483934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-07f9fc7c-207c-4027-b626-2670ef407366 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:35.486588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-07f9fc7c-207c-4027-b626-2670ef407366 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:35.487864 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-07f9fc7c-207c-4027-b626-2670ef407366 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1745 microversion: 2.20 time: 0.153176 Aug 30 07:58:35.488430 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 670/1387] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:35 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:35.635911 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cc924cf1-06da-4ed5-8b8f-77ae57d7453b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:35.636897 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cc924cf1-06da-4ed5-8b8f-77ae57d7453b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:35.643537 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc924cf1-06da-4ed5-8b8f-77ae57d7453b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:35.643987 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc924cf1-06da-4ed5-8b8f-77ae57d7453b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:35.644751 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc924cf1-06da-4ed5-8b8f-77ae57d7453b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:35.645187 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cc924cf1-06da-4ed5-8b8f-77ae57d7453b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:35.673281 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cc924cf1-06da-4ed5-8b8f-77ae57d7453b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041169 Aug 30 07:58:35.674002 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 718/1388] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:58:35 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:58:35.683523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b454a3b3-627a-48e1-a845-07d6540397de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:35.684020 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b454a3b3-627a-48e1-a845-07d6540397de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:35.690666 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b454a3b3-627a-48e1-a845-07d6540397de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:35.691112 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b454a3b3-627a-48e1-a845-07d6540397de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:35.691896 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b454a3b3-627a-48e1-a845-07d6540397de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:35.692330 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b454a3b3-627a-48e1-a845-07d6540397de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:35.722405 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b454a3b3-627a-48e1-a845-07d6540397de tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments/3bd7f203-77c6-4aa2-97b9-dd25d97c045e" status: 200 len: 194 microversion: 2.1 time: 0.042515 Aug 30 07:58:35.723180 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 671/1389] 10.222.0.73 () {58 vars in 1413 bytes} [Mon Aug 30 07:58:35 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments/3bd7f203-77c6-4aa2-97b9-dd25d97c045e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:58:36.506527 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-df27b13a-0035-408e-816f-fd5d78d30744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:36.507164 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-df27b13a-0035-408e-816f-fd5d78d30744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:36.513454 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df27b13a-0035-408e-816f-fd5d78d30744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:36.513929 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df27b13a-0035-408e-816f-fd5d78d30744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:36.514720 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df27b13a-0035-408e-816f-fd5d78d30744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:36.515156 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-df27b13a-0035-408e-816f-fd5d78d30744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:36.638363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-df27b13a-0035-408e-816f-fd5d78d30744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:36.646088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-df27b13a-0035-408e-816f-fd5d78d30744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:36.647625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-df27b13a-0035-408e-816f-fd5d78d30744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:36.648771 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-df27b13a-0035-408e-816f-fd5d78d30744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1745 microversion: 2.20 time: 0.146098 Aug 30 07:58:36.649322 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 719/1390] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:36 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1745 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:37.288647 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-1bebe4b1-6e6b-4bb0-ba59-f57817d59d8a req-62eb28a5-c537-40be-a3ae-da924c263d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bba115-ffa4-48f5-9f97-30c8117579c2", "name": "network-vif-plugged", "status": "completed", "tag": "433de034-350e-4435-8de8-087595037325"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:37.290295 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:58:37.290295 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:58:37.297070 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-1bebe4b1-6e6b-4bb0-ba59-f57817d59d8a req-62eb28a5-c537-40be-a3ae-da924c263d27 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:37.297757 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-1bebe4b1-6e6b-4bb0-ba59-f57817d59d8a req-62eb28a5-c537-40be-a3ae-da924c263d27 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:37.308626 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-1bebe4b1-6e6b-4bb0-ba59-f57817d59d8a req-62eb28a5-c537-40be-a3ae-da924c263d27 service nova] Creating event network-vif-plugged:433de034-350e-4435-8de8-087595037325 for instance 04bba115-ffa4-48f5-9f97-30c8117579c2 on hv-cinder-80619 Aug 30 07:58:37.314481 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-1bebe4b1-6e6b-4bb0-ba59-f57817d59d8a req-62eb28a5-c537-40be-a3ae-da924c263d27 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029453 Aug 30 07:58:37.315149 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 672/1391] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:58:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:58:37.667338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-44e1ab41-4326-40ae-b4fa-09d74ab13527 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:37.667953 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-44e1ab41-4326-40ae-b4fa-09d74ab13527 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:37.673874 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44e1ab41-4326-40ae-b4fa-09d74ab13527 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:37.674359 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44e1ab41-4326-40ae-b4fa-09d74ab13527 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:37.675133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44e1ab41-4326-40ae-b4fa-09d74ab13527 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:37.675596 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44e1ab41-4326-40ae-b4fa-09d74ab13527 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:37.796576 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-44e1ab41-4326-40ae-b4fa-09d74ab13527 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:37.804302 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-44e1ab41-4326-40ae-b4fa-09d74ab13527 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:37.805917 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-44e1ab41-4326-40ae-b4fa-09d74ab13527 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:37.806999 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-44e1ab41-4326-40ae-b4fa-09d74ab13527 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1745 microversion: 2.20 time: 0.143368 Aug 30 07:58:37.807549 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 720/1392] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:37 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1745 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:38.098940 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-db920ad6-b78b-488a-9ba5-c556167cff48 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71786385-915c-41c3-9f7b-9e80c4761db0"}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:38.100059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-db920ad6-b78b-488a-9ba5-c556167cff48 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:38.106034 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db920ad6-b78b-488a-9ba5-c556167cff48 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:38.106518 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db920ad6-b78b-488a-9ba5-c556167cff48 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:38.107818 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db920ad6-b78b-488a-9ba5-c556167cff48 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:38.108246 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db920ad6-b78b-488a-9ba5-c556167cff48 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:38.342827 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-db920ad6-b78b-488a-9ba5-c556167cff48 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247892 Aug 30 07:58:38.343529 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 673/1393] 10.222.0.73 () {60 vars in 1323 bytes} [Mon Aug 30 07:58:38 2021] POST /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:58:38.825192 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-55c08407-6102-4bfe-a908-67a522c631b9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:38.826382 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-55c08407-6102-4bfe-a908-67a522c631b9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:38.832193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-55c08407-6102-4bfe-a908-67a522c631b9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:38.832637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-55c08407-6102-4bfe-a908-67a522c631b9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:38.833393 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-55c08407-6102-4bfe-a908-67a522c631b9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:38.833826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-55c08407-6102-4bfe-a908-67a522c631b9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:38.955787 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-55c08407-6102-4bfe-a908-67a522c631b9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:38.963420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-55c08407-6102-4bfe-a908-67a522c631b9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:38.964912 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-55c08407-6102-4bfe-a908-67a522c631b9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:38.966042 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-55c08407-6102-4bfe-a908-67a522c631b9 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1745 microversion: 2.20 time: 0.144578 Aug 30 07:58:38.967745 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 721/1394] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:38 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1745 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:39.988026 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7e17fe99-bcd1-4a2d-8f27-f9eead4bae7f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:39.988724 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7e17fe99-bcd1-4a2d-8f27-f9eead4bae7f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:39.996020 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e17fe99-bcd1-4a2d-8f27-f9eead4bae7f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:39.996468 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e17fe99-bcd1-4a2d-8f27-f9eead4bae7f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:39.997217 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e17fe99-bcd1-4a2d-8f27-f9eead4bae7f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:39.997649 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-7e17fe99-bcd1-4a2d-8f27-f9eead4bae7f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:40.120907 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7e17fe99-bcd1-4a2d-8f27-f9eead4bae7f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:40.128798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7e17fe99-bcd1-4a2d-8f27-f9eead4bae7f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:40.130309 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7e17fe99-bcd1-4a2d-8f27-f9eead4bae7f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:40.131449 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7e17fe99-bcd1-4a2d-8f27-f9eead4bae7f tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1745 microversion: 2.20 time: 0.150192 Aug 30 07:58:40.132014 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 674/1395] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:39 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:41.149740 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0fca5d67-57e9-42f1-ae8e-9a2cc0e73690 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:41.150376 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0fca5d67-57e9-42f1-ae8e-9a2cc0e73690 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:41.156505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0fca5d67-57e9-42f1-ae8e-9a2cc0e73690 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:41.157191 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0fca5d67-57e9-42f1-ae8e-9a2cc0e73690 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:41.158175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0fca5d67-57e9-42f1-ae8e-9a2cc0e73690 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:41.158950 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0fca5d67-57e9-42f1-ae8e-9a2cc0e73690 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:41.289085 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0fca5d67-57e9-42f1-ae8e-9a2cc0e73690 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:41.298532 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0fca5d67-57e9-42f1-ae8e-9a2cc0e73690 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:41.300428 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0fca5d67-57e9-42f1-ae8e-9a2cc0e73690 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:41.301724 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0fca5d67-57e9-42f1-ae8e-9a2cc0e73690 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.155850 Aug 30 07:58:41.302371 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 722/1396] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:41 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:58:42.321006 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f88d51ce-628b-4e40-9ccb-1553b29c4cbe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:42.322237 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f88d51ce-628b-4e40-9ccb-1553b29c4cbe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:42.329111 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f88d51ce-628b-4e40-9ccb-1553b29c4cbe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:42.329706 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f88d51ce-628b-4e40-9ccb-1553b29c4cbe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:42.330692 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f88d51ce-628b-4e40-9ccb-1553b29c4cbe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:42.331288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f88d51ce-628b-4e40-9ccb-1553b29c4cbe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:42.456265 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f88d51ce-628b-4e40-9ccb-1553b29c4cbe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:42.463844 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f88d51ce-628b-4e40-9ccb-1553b29c4cbe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:42.465350 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f88d51ce-628b-4e40-9ccb-1553b29c4cbe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:42.466508 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f88d51ce-628b-4e40-9ccb-1553b29c4cbe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.149547 Aug 30 07:58:42.467058 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 675/1397] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:42 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:43.484795 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6821d390-5f40-4e6c-a178-f8549ae12ce3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:43.485661 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6821d390-5f40-4e6c-a178-f8549ae12ce3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:43.492090 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6821d390-5f40-4e6c-a178-f8549ae12ce3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:43.492556 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6821d390-5f40-4e6c-a178-f8549ae12ce3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:43.493331 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6821d390-5f40-4e6c-a178-f8549ae12ce3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:43.493762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6821d390-5f40-4e6c-a178-f8549ae12ce3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:43.625657 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6821d390-5f40-4e6c-a178-f8549ae12ce3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:43.634223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6821d390-5f40-4e6c-a178-f8549ae12ce3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:43.635557 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6821d390-5f40-4e6c-a178-f8549ae12ce3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:43.636725 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6821d390-5f40-4e6c-a178-f8549ae12ce3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.155924 Aug 30 07:58:43.637275 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 723/1398] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:43 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:44.655129 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-68d21495-4bc4-479f-a0df-1e15ab9c2472 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:44.655739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-68d21495-4bc4-479f-a0df-1e15ab9c2472 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:44.662861 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-68d21495-4bc4-479f-a0df-1e15ab9c2472 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:44.663309 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-68d21495-4bc4-479f-a0df-1e15ab9c2472 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:44.664105 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-68d21495-4bc4-479f-a0df-1e15ab9c2472 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:44.664541 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-68d21495-4bc4-479f-a0df-1e15ab9c2472 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:44.791053 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-68d21495-4bc4-479f-a0df-1e15ab9c2472 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:44.798894 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-68d21495-4bc4-479f-a0df-1e15ab9c2472 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:44.800370 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-68d21495-4bc4-479f-a0df-1e15ab9c2472 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:44.801514 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-68d21495-4bc4-479f-a0df-1e15ab9c2472 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.150107 Aug 30 07:58:44.802061 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 676/1399] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:44 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:58:45.821065 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-32f01d96-6d7a-4ee2-9e24-a8edf21fa6a7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:45.821708 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-32f01d96-6d7a-4ee2-9e24-a8edf21fa6a7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:45.828368 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32f01d96-6d7a-4ee2-9e24-a8edf21fa6a7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:45.828886 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32f01d96-6d7a-4ee2-9e24-a8edf21fa6a7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:45.830193 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32f01d96-6d7a-4ee2-9e24-a8edf21fa6a7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:45.830855 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-32f01d96-6d7a-4ee2-9e24-a8edf21fa6a7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:45.894454 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-408dfab4-a110-47d6-9d56-4b0c1d0f5cde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:45.896142 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-408dfab4-a110-47d6-9d56-4b0c1d0f5cde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:45.902250 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-408dfab4-a110-47d6-9d56-4b0c1d0f5cde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:45.902740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-408dfab4-a110-47d6-9d56-4b0c1d0f5cde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:45.903519 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-408dfab4-a110-47d6-9d56-4b0c1d0f5cde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:45.903955 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-408dfab4-a110-47d6-9d56-4b0c1d0f5cde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:45.936568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-408dfab4-a110-47d6-9d56-4b0c1d0f5cde tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045907 Aug 30 07:58:45.937132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 677/1400] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:58:45 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:58:45.960010 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-32f01d96-6d7a-4ee2-9e24-a8edf21fa6a7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:45.968003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-32f01d96-6d7a-4ee2-9e24-a8edf21fa6a7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:45.970013 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-32f01d96-6d7a-4ee2-9e24-a8edf21fa6a7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:45.971223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-32f01d96-6d7a-4ee2-9e24-a8edf21fa6a7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.154291 Aug 30 07:58:45.971764 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 724/1401] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:45 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:46.989592 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-56399541-549a-4e93-83db-80b1f95aa54b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:46.990792 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-56399541-549a-4e93-83db-80b1f95aa54b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:46.997624 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-56399541-549a-4e93-83db-80b1f95aa54b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:46.998173 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-56399541-549a-4e93-83db-80b1f95aa54b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:46.999137 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-56399541-549a-4e93-83db-80b1f95aa54b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:46.999567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-56399541-549a-4e93-83db-80b1f95aa54b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:47.125305 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-56399541-549a-4e93-83db-80b1f95aa54b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:47.135479 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-56399541-549a-4e93-83db-80b1f95aa54b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:47.137108 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-56399541-549a-4e93-83db-80b1f95aa54b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:47.138607 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-56399541-549a-4e93-83db-80b1f95aa54b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.152806 Aug 30 07:58:47.139159 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 678/1402] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:46 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:48.156962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-de7782d9-4c13-4410-b3a1-d42178807055 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:48.158124 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-de7782d9-4c13-4410-b3a1-d42178807055 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:48.166549 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de7782d9-4c13-4410-b3a1-d42178807055 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:48.167115 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de7782d9-4c13-4410-b3a1-d42178807055 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:48.167969 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de7782d9-4c13-4410-b3a1-d42178807055 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:48.168493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de7782d9-4c13-4410-b3a1-d42178807055 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:48.294328 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-de7782d9-4c13-4410-b3a1-d42178807055 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:48.302127 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-de7782d9-4c13-4410-b3a1-d42178807055 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:48.303660 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-de7782d9-4c13-4410-b3a1-d42178807055 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:48.304788 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-de7782d9-4c13-4410-b3a1-d42178807055 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.151612 Aug 30 07:58:48.309472 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 725/1403] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:48 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:49.323485 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4c619b82-27b3-42c8-a591-5637f8964de3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:49.324429 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4c619b82-27b3-42c8-a591-5637f8964de3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:49.331626 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4c619b82-27b3-42c8-a591-5637f8964de3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:49.332073 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4c619b82-27b3-42c8-a591-5637f8964de3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:49.332836 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4c619b82-27b3-42c8-a591-5637f8964de3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:49.333269 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4c619b82-27b3-42c8-a591-5637f8964de3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:49.472615 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4c619b82-27b3-42c8-a591-5637f8964de3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:49.483143 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4c619b82-27b3-42c8-a591-5637f8964de3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:49.484695 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4c619b82-27b3-42c8-a591-5637f8964de3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:49.487560 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4c619b82-27b3-42c8-a591-5637f8964de3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.167736 Aug 30 07:58:49.490500 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 679/1404] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:49 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:50.504966 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-50b256ef-f887-425d-8728-8ff77cfa2109 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:50.506211 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-50b256ef-f887-425d-8728-8ff77cfa2109 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:50.513837 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50b256ef-f887-425d-8728-8ff77cfa2109 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:50.514626 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50b256ef-f887-425d-8728-8ff77cfa2109 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:50.515659 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50b256ef-f887-425d-8728-8ff77cfa2109 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:50.516333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-50b256ef-f887-425d-8728-8ff77cfa2109 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:50.645528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-50b256ef-f887-425d-8728-8ff77cfa2109 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:50.654357 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-50b256ef-f887-425d-8728-8ff77cfa2109 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:50.656333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-50b256ef-f887-425d-8728-8ff77cfa2109 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:50.657985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-50b256ef-f887-425d-8728-8ff77cfa2109 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.156538 Aug 30 07:58:50.664324 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 726/1405] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:50 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:51.677123 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-55e8ca3a-1760-40c8-a225-2b08a3a08d60 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:51.677816 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-55e8ca3a-1760-40c8-a225-2b08a3a08d60 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:51.683668 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-55e8ca3a-1760-40c8-a225-2b08a3a08d60 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:51.684138 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-55e8ca3a-1760-40c8-a225-2b08a3a08d60 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:51.684915 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-55e8ca3a-1760-40c8-a225-2b08a3a08d60 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:51.685357 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-55e8ca3a-1760-40c8-a225-2b08a3a08d60 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:51.807515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-55e8ca3a-1760-40c8-a225-2b08a3a08d60 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:51.816003 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-55e8ca3a-1760-40c8-a225-2b08a3a08d60 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:51.817511 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-55e8ca3a-1760-40c8-a225-2b08a3a08d60 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:51.818682 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-55e8ca3a-1760-40c8-a225-2b08a3a08d60 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.145855 Aug 30 07:58:51.819407 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 680/1406] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:51 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:52.837637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5750b33e-67a2-4587-9ede-cc2b5908e4d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:52.838477 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5750b33e-67a2-4587-9ede-cc2b5908e4d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:52.844885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5750b33e-67a2-4587-9ede-cc2b5908e4d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:52.845327 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5750b33e-67a2-4587-9ede-cc2b5908e4d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:52.846081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5750b33e-67a2-4587-9ede-cc2b5908e4d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:52.846594 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5750b33e-67a2-4587-9ede-cc2b5908e4d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:52.972284 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5750b33e-67a2-4587-9ede-cc2b5908e4d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:52.981222 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5750b33e-67a2-4587-9ede-cc2b5908e4d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:52.983103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5750b33e-67a2-4587-9ede-cc2b5908e4d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:52.984340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5750b33e-67a2-4587-9ede-cc2b5908e4d4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.150641 Aug 30 07:58:52.995882 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 727/1407] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:52 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:54.003991 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c4cb0179-d641-419e-a4f7-dc12149d2d36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:54.004600 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c4cb0179-d641-419e-a4f7-dc12149d2d36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:54.011066 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4cb0179-d641-419e-a4f7-dc12149d2d36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:54.011513 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4cb0179-d641-419e-a4f7-dc12149d2d36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:54.012271 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4cb0179-d641-419e-a4f7-dc12149d2d36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:54.012700 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4cb0179-d641-419e-a4f7-dc12149d2d36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:54.141623 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c4cb0179-d641-419e-a4f7-dc12149d2d36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:54.150277 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c4cb0179-d641-419e-a4f7-dc12149d2d36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:54.151773 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c4cb0179-d641-419e-a4f7-dc12149d2d36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:54.152916 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c4cb0179-d641-419e-a4f7-dc12149d2d36 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.153229 Aug 30 07:58:54.153469 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 681/1408] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:53 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:55.173412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2c96c51b-0a53-4319-9e94-d676c2ae8654 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:55.173412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2c96c51b-0a53-4319-9e94-d676c2ae8654 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:55.179492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2c96c51b-0a53-4319-9e94-d676c2ae8654 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:55.180149 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2c96c51b-0a53-4319-9e94-d676c2ae8654 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:55.180960 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2c96c51b-0a53-4319-9e94-d676c2ae8654 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:55.181395 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2c96c51b-0a53-4319-9e94-d676c2ae8654 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:55.311910 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2c96c51b-0a53-4319-9e94-d676c2ae8654 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:55.319683 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2c96c51b-0a53-4319-9e94-d676c2ae8654 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:55.321170 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2c96c51b-0a53-4319-9e94-d676c2ae8654 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:55.322330 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2c96c51b-0a53-4319-9e94-d676c2ae8654 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1740 microversion: 2.20 time: 0.155066 Aug 30 07:58:55.322874 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 728/1409] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:55 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:58:55.807242 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1461496008", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-763817541", "security_groups": [{"name": "tempest-secgroup-smoke-297578174"}], "networks": [{"uuid": "014bc288-d267-4224-b8fa-855b955d7cfd"}], "block_device_mapping_v2": [{"uuid": "8b84e5e6-5602-4dca-8c46-a16f25f46162", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:55.909283 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] validate_networks() for [('014bc288-d267-4224-b8fa-855b955d7cfd', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 07:58:56.340560 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-502733e1-85b0-456f-8da6-46183d05e481 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:56.341285 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-502733e1-85b0-456f-8da6-46183d05e481 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:56.347497 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-502733e1-85b0-456f-8da6-46183d05e481 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:56.347953 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-502733e1-85b0-456f-8da6-46183d05e481 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:56.348724 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-502733e1-85b0-456f-8da6-46183d05e481 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:56.349164 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-502733e1-85b0-456f-8da6-46183d05e481 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:56.461494 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 07:58:56.461919 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 07:58:56.463012 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 07:58:56.463439 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 07:58:56.463891 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 07:58:56.473460 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:56.473911 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:56.474761 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:56.475198 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:56.475534 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-502733e1-85b0-456f-8da6-46183d05e481 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:56.483982 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-502733e1-85b0-456f-8da6-46183d05e481 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:56.485623 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-502733e1-85b0-456f-8da6-46183d05e481 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:56.486793 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-502733e1-85b0-456f-8da6-46183d05e481 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1722 microversion: 2.20 time: 0.150005 Aug 30 07:58:56.498318 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 729/1410] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:56 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:58:56.498485 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Getting quotas for project 3748b4459c5b4b0eb1eae5f1a86e1d28. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 07:58:56.498485 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Getting quotas for user d2a305429eb64d259972aae774b6d7bc and project 3748b4459c5b4b0eb1eae5f1a86e1d28. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 07:58:56.557381 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 07:58:56.559542 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b84e5e6-5602-4dca-8c46-a16f25f46162',volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 07:58:56.682316 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-80a34326-20be-4550-9d84-81a93d296c51 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.878640 Aug 30 07:58:56.687911 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 682/1411] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 07:58:55 2021] POST /compute/v2.1/servers => generated 405 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 07:58:56.692635 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a40c3adb-a8e9-43a2-bf79-642120061699 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:56.693246 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a40c3adb-a8e9-43a2-bf79-642120061699 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:56.745612 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a40c3adb-a8e9-43a2-bf79-642120061699 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:56.752253 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a40c3adb-a8e9-43a2-bf79-642120061699 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1088 microversion: 2.1 time: 0.063223 Aug 30 07:58:56.752862 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 730/1412] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:58:56 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1088 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:58:57.506450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d90f7456-39bc-4829-8528-b87727acf44d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:57.507071 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d90f7456-39bc-4829-8528-b87727acf44d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:57.513597 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d90f7456-39bc-4829-8528-b87727acf44d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:57.514045 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d90f7456-39bc-4829-8528-b87727acf44d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:57.514836 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d90f7456-39bc-4829-8528-b87727acf44d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:57.515270 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d90f7456-39bc-4829-8528-b87727acf44d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:57.639819 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d90f7456-39bc-4829-8528-b87727acf44d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:57.647548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d90f7456-39bc-4829-8528-b87727acf44d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:57.649039 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d90f7456-39bc-4829-8528-b87727acf44d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:57.650198 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d90f7456-39bc-4829-8528-b87727acf44d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1722 microversion: 2.20 time: 0.148187 Aug 30 07:58:57.650749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 683/1413] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:57 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:57.771075 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-09658cb3-dd34-49cb-a460-ae178d14df1b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:57.771618 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-09658cb3-dd34-49cb-a460-ae178d14df1b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:57.825652 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-09658cb3-dd34-49cb-a460-ae178d14df1b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:57.832945 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-09658cb3-dd34-49cb-a460-ae178d14df1b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1088 microversion: 2.1 time: 0.065794 Aug 30 07:58:57.833501 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 731/1414] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:58:57 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:58:58.668601 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-05c56344-3ead-45cd-8a0e-e9e955c7df7b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:58.669329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-05c56344-3ead-45cd-8a0e-e9e955c7df7b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:58.675439 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05c56344-3ead-45cd-8a0e-e9e955c7df7b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:58.675941 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05c56344-3ead-45cd-8a0e-e9e955c7df7b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:58.676856 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05c56344-3ead-45cd-8a0e-e9e955c7df7b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:58.677298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05c56344-3ead-45cd-8a0e-e9e955c7df7b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:58.794864 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-05c56344-3ead-45cd-8a0e-e9e955c7df7b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:58.802527 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-05c56344-3ead-45cd-8a0e-e9e955c7df7b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:58.804016 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-05c56344-3ead-45cd-8a0e-e9e955c7df7b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:58.805167 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-05c56344-3ead-45cd-8a0e-e9e955c7df7b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1725 microversion: 2.20 time: 0.140968 Aug 30 07:58:58.805733 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 684/1415] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:58:58 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:58:58.822902 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c6efc799-7c35-4b6f-af28-abf960b28be4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31480698-51ec-49b8-8d46-ea1376de342f"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:58.824011 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c6efc799-7c35-4b6f-af28-abf960b28be4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:58.829810 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c6efc799-7c35-4b6f-af28-abf960b28be4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:58.830286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c6efc799-7c35-4b6f-af28-abf960b28be4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:58.831037 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c6efc799-7c35-4b6f-af28-abf960b28be4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:58.831472 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c6efc799-7c35-4b6f-af28-abf960b28be4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:58.848676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-33733c54-0e73-4d0a-8ff0-83fc3d732361 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:58.850004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-33733c54-0e73-4d0a-8ff0-83fc3d732361 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:58.922631 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-33733c54-0e73-4d0a-8ff0-83fc3d732361 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:58:58.930679 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-33733c54-0e73-4d0a-8ff0-83fc3d732361 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1088 microversion: 2.1 time: 0.085613 Aug 30 07:58:58.939779 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 685/1416] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:58:58 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:58:59.130187 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c6efc799-7c35-4b6f-af28-abf960b28be4 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.310356 Aug 30 07:58:59.130787 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 732/1417] 10.222.0.73 () {62 vars in 1364 bytes} [Mon Aug 30 07:58:58 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 07:58:59.255684 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cbd7e486-0e82-4805-9b19-b3cabdeaec8b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:59.256193 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-cbd7e486-0e82-4805-9b19-b3cabdeaec8b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:59.261778 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cbd7e486-0e82-4805-9b19-b3cabdeaec8b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:59.262264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cbd7e486-0e82-4805-9b19-b3cabdeaec8b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:59.263024 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cbd7e486-0e82-4805-9b19-b3cabdeaec8b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:59.263456 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cbd7e486-0e82-4805-9b19-b3cabdeaec8b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:59.388569 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-45931c36-9c77-4bf8-b4bc-1a41d3007eb8 req-f7e83a16-5374-44de-8732-53091389a947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bba115-ffa4-48f5-9f97-30c8117579c2", "name": "network-vif-unplugged", "status": "completed", "tag": "433de034-350e-4435-8de8-087595037325"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:59.390124 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:58:59.390124 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:58:59.398117 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-45931c36-9c77-4bf8-b4bc-1a41d3007eb8 req-f7e83a16-5374-44de-8732-53091389a947 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:59.398585 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-45931c36-9c77-4bf8-b4bc-1a41d3007eb8 req-f7e83a16-5374-44de-8732-53091389a947 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:59.408839 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.compute.server_external_events [req-45931c36-9c77-4bf8-b4bc-1a41d3007eb8 req-f7e83a16-5374-44de-8732-53091389a947 service nova] Unable to find a host for instance 04bba115-ffa4-48f5-9f97-30c8117579c2. Dropping event network-vif-unplugged {{(pid=114671) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 30 07:58:59.409714 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-45931c36-9c77-4bf8-b4bc-1a41d3007eb8 req-f7e83a16-5374-44de-8732-53091389a947 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.093996 Aug 30 07:58:59.411142 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 733/1418] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:58:59 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 96 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 07:58:59.524172 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-cbd7e486-0e82-4805-9b19-b3cabdeaec8b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "DELETE /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/os-volume_attachments/31480698-51ec-49b8-8d46-ea1376de342f" status: 202 len: 0 microversion: 2.20 time: 0.273051 Aug 30 07:58:59.524740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 686/1419] 10.222.0.73 () {60 vars in 1457 bytes} [Mon Aug 30 07:58:59 2021] DELETE /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/os-volume_attachments/31480698-51ec-49b8-8d46-ea1376de342f => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:58:59.581985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6384e0ac-bf86-4195-b929-dfe29600b45d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:58:59.582737 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6384e0ac-bf86-4195-b929-dfe29600b45d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:58:59.588413 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6384e0ac-bf86-4195-b929-dfe29600b45d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:59.588850 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6384e0ac-bf86-4195-b929-dfe29600b45d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:59.589599 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6384e0ac-bf86-4195-b929-dfe29600b45d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:58:59.590024 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6384e0ac-bf86-4195-b929-dfe29600b45d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:58:59.661636 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6384e0ac-bf86-4195-b929-dfe29600b45d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [4794119c-2122-449d-97d2-ccf4dd74830e] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 07:58:59.946729 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5a89d0c4-a2e2-45c3-be91-151b7d644761 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:58:59.947346 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5a89d0c4-a2e2-45c3-be91-151b7d644761 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:00.004528 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5a89d0c4-a2e2-45c3-be91-151b7d644761 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:00.011181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5a89d0c4-a2e2-45c3-be91-151b7d644761 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1088 microversion: 2.1 time: 0.068165 Aug 30 07:59:00.011743 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 687/1420] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:58:59 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:59:00.677064 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO oslo.messaging._drivers.impl_rabbit [None req-6384e0ac-bf86-4195-b929-dfe29600b45d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [4794119c-2122-449d-97d2-ccf4dd74830e] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 60782. Aug 30 07:59:00.680717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6384e0ac-bf86-4195-b929-dfe29600b45d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action" status: 202 len: 0 microversion: 2.20 time: 1.102487 Aug 30 07:59:00.681400 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 734/1421] 10.222.0.73 () {62 vars in 1319 bytes} [Mon Aug 30 07:58:59 2021] POST /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/action => generated 0 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 07:59:00.689321 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-db684d4f-0941-4e28-a374-0610db64ab67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:00.689930 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-db684d4f-0941-4e28-a374-0610db64ab67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:00.697098 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db684d4f-0941-4e28-a374-0610db64ab67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:00.697539 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db684d4f-0941-4e28-a374-0610db64ab67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:00.698362 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db684d4f-0941-4e28-a374-0610db64ab67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:00.698792 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-db684d4f-0941-4e28-a374-0610db64ab67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:00.823398 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-db684d4f-0941-4e28-a374-0610db64ab67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:00.831287 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-db684d4f-0941-4e28-a374-0610db64ab67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:00.832858 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-db684d4f-0941-4e28-a374-0610db64ab67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:00.834003 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-db684d4f-0941-4e28-a374-0610db64ab67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1673 microversion: 2.20 time: 0.148413 Aug 30 07:59:00.834595 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 688/1422] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:00 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:59:01.028078 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a7a9a032-59b2-49ec-9f2b-2033bd48ab5e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:01.028689 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a7a9a032-59b2-49ec-9f2b-2033bd48ab5e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:01.035022 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a7a9a032-59b2-49ec-9f2b-2033bd48ab5e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:01.035471 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a7a9a032-59b2-49ec-9f2b-2033bd48ab5e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:01.036422 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a7a9a032-59b2-49ec-9f2b-2033bd48ab5e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:01.037726 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a7a9a032-59b2-49ec-9f2b-2033bd48ab5e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:01.112152 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a7a9a032-59b2-49ec-9f2b-2033bd48ab5e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:01.120958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a7a9a032-59b2-49ec-9f2b-2033bd48ab5e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1138 microversion: 2.1 time: 0.096439 Aug 30 07:59:01.121536 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 735/1423] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:01 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1138 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:01.702043 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f6a62b0a-f63d-426a-bf3a-34eb3ca1ba94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:01.702659 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f6a62b0a-f63d-426a-bf3a-34eb3ca1ba94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:01.708344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6a62b0a-f63d-426a-bf3a-34eb3ca1ba94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:01.709425 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6a62b0a-f63d-426a-bf3a-34eb3ca1ba94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:01.710339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6a62b0a-f63d-426a-bf3a-34eb3ca1ba94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:01.710814 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6a62b0a-f63d-426a-bf3a-34eb3ca1ba94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:01.740318 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f6a62b0a-f63d-426a-bf3a-34eb3ca1ba94 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments/3bd7f203-77c6-4aa2-97b9-dd25d97c045e" status: 200 len: 194 microversion: 2.1 time: 0.041906 Aug 30 07:59:01.741182 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 689/1424] 10.222.0.73 () {58 vars in 1413 bytes} [Mon Aug 30 07:59:01 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments/3bd7f203-77c6-4aa2-97b9-dd25d97c045e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:59:01.750630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c4ac6fa2-b183-4446-9367-45d2251fd4bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:01.751139 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c4ac6fa2-b183-4446-9367-45d2251fd4bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:01.757512 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c4ac6fa2-b183-4446-9367-45d2251fd4bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:01.758051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c4ac6fa2-b183-4446-9367-45d2251fd4bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:01.758849 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c4ac6fa2-b183-4446-9367-45d2251fd4bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:01.759271 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c4ac6fa2-b183-4446-9367-45d2251fd4bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:01.850099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-c4ac6fa2-b183-4446-9367-45d2251fd4bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lazy-loading 'services' on Instance uuid 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:59:01.858381 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-44d150ff-b3cd-46d3-a644-46a2a827eafe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:01.859013 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-44d150ff-b3cd-46d3-a644-46a2a827eafe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:01.865724 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-44d150ff-b3cd-46d3-a644-46a2a827eafe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:01.866276 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-44d150ff-b3cd-46d3-a644-46a2a827eafe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:01.867060 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-44d150ff-b3cd-46d3-a644-46a2a827eafe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:01.867501 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-44d150ff-b3cd-46d3-a644-46a2a827eafe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:01.927091 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c4ac6fa2-b183-4446-9367-45d2251fd4bf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments/3bd7f203-77c6-4aa2-97b9-dd25d97c045e" status: 202 len: 0 microversion: 2.1 time: 0.180126 Aug 30 07:59:01.927792 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 736/1425] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:59:01 2021] DELETE /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments/3bd7f203-77c6-4aa2-97b9-dd25d97c045e => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 07:59:02.139041 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c5fa6d51-279d-4498-a1b1-00b6d3d5f6e5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:02.140056 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c5fa6d51-279d-4498-a1b1-00b6d3d5f6e5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:02.146915 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5fa6d51-279d-4498-a1b1-00b6d3d5f6e5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:02.147502 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5fa6d51-279d-4498-a1b1-00b6d3d5f6e5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:02.149149 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5fa6d51-279d-4498-a1b1-00b6d3d5f6e5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:02.149930 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5fa6d51-279d-4498-a1b1-00b6d3d5f6e5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:02.219647 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c5fa6d51-279d-4498-a1b1-00b6d3d5f6e5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:02.227808 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c5fa6d51-279d-4498-a1b1-00b6d3d5f6e5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1204 microversion: 2.1 time: 0.092765 Aug 30 07:59:02.228395 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 737/1426] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:02 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1204 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:59:02.435506 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-44d150ff-b3cd-46d3-a644-46a2a827eafe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:02.445072 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-44d150ff-b3cd-46d3-a644-46a2a827eafe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:02.447214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-44d150ff-b3cd-46d3-a644-46a2a827eafe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:02.448608 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-44d150ff-b3cd-46d3-a644-46a2a827eafe tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1673 microversion: 2.20 time: 0.597902 Aug 30 07:59:02.449790 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 690/1427] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:01 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1673 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:59:03.244937 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6f1219c6-ae2b-4fe7-8c88-9039caead073 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:03.245579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6f1219c6-ae2b-4fe7-8c88-9039caead073 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:03.254027 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f1219c6-ae2b-4fe7-8c88-9039caead073 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:03.254503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f1219c6-ae2b-4fe7-8c88-9039caead073 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:03.255297 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f1219c6-ae2b-4fe7-8c88-9039caead073 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:03.256279 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6f1219c6-ae2b-4fe7-8c88-9039caead073 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:03.442838 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6f1219c6-ae2b-4fe7-8c88-9039caead073 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:03.452894 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6f1219c6-ae2b-4fe7-8c88-9039caead073 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.210700 Aug 30 07:59:03.453937 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 738/1428] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:03 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:03.469402 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-703c6229-1bc7-456f-8a45-52b808770362 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:03.470122 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-703c6229-1bc7-456f-8a45-52b808770362 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:03.477297 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-703c6229-1bc7-456f-8a45-52b808770362 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:03.478458 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-703c6229-1bc7-456f-8a45-52b808770362 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:03.479298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-703c6229-1bc7-456f-8a45-52b808770362 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:03.480549 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-703c6229-1bc7-456f-8a45-52b808770362 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:03.684318 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-703c6229-1bc7-456f-8a45-52b808770362 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:03.691884 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-703c6229-1bc7-456f-8a45-52b808770362 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:03.693396 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-703c6229-1bc7-456f-8a45-52b808770362 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:03.695187 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-703c6229-1bc7-456f-8a45-52b808770362 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1673 microversion: 2.20 time: 0.230317 Aug 30 07:59:03.695755 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 691/1429] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:03 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1673 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:04.001974 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-73385ccb-1395-4ddf-9f39-87ef8f3eaea7 req-157a5d63-5c79-45e1-b5a5-cd7d49a49b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f7a4654-a0be-4fa9-b45b-acbd7ba764e9", "tag": "df6e2650-791e-4b79-8911-dc23e2079687"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:59:04.003641 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:59:04.003641 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:59:04.010773 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-73385ccb-1395-4ddf-9f39-87ef8f3eaea7 req-157a5d63-5c79-45e1-b5a5-cd7d49a49b8a service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:04.011522 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-73385ccb-1395-4ddf-9f39-87ef8f3eaea7 req-157a5d63-5c79-45e1-b5a5-cd7d49a49b8a service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:04.026298 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-73385ccb-1395-4ddf-9f39-87ef8f3eaea7 req-157a5d63-5c79-45e1-b5a5-cd7d49a49b8a service nova] Creating event network-changed:df6e2650-791e-4b79-8911-dc23e2079687 for instance 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 on hv-cinder-80619 Aug 30 07:59:04.030988 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-73385ccb-1395-4ddf-9f39-87ef8f3eaea7 req-157a5d63-5c79-45e1-b5a5-cd7d49a49b8a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032567 Aug 30 07:59:04.031615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 739/1430] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:59:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:59:04.121754 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8e0881c6-6f8b-43a8-b166-28473661b6c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:04.122562 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8e0881c6-6f8b-43a8-b166-28473661b6c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:04.128840 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e0881c6-6f8b-43a8-b166-28473661b6c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:04.129296 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e0881c6-6f8b-43a8-b166-28473661b6c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:04.130077 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e0881c6-6f8b-43a8-b166-28473661b6c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:04.130544 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8e0881c6-6f8b-43a8-b166-28473661b6c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:04.161610 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8e0881c6-6f8b-43a8-b166-28473661b6c8 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments/71786385-915c-41c3-9f7b-9e80c4761db0" status: 200 len: 194 microversion: 2.1 time: 0.043814 Aug 30 07:59:04.162728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 692/1431] 10.222.0.73 () {58 vars in 1413 bytes} [Mon Aug 30 07:59:04 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments/71786385-915c-41c3-9f7b-9e80c4761db0 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:59:04.173121 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-44db54e5-960d-44fd-8772-30b4e51008db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:04.174981 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-44db54e5-960d-44fd-8772-30b4e51008db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:04.182429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44db54e5-960d-44fd-8772-30b4e51008db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:04.182879 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44db54e5-960d-44fd-8772-30b4e51008db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:04.183657 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44db54e5-960d-44fd-8772-30b4e51008db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:04.184096 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-44db54e5-960d-44fd-8772-30b4e51008db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:04.268764 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.objects.instance [None req-44db54e5-960d-44fd-8772-30b4e51008db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lazy-loading 'services' on Instance uuid 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d {{(pid=114671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:59:04.341823 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-44db54e5-960d-44fd-8772-30b4e51008db tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments/71786385-915c-41c3-9f7b-9e80c4761db0" status: 202 len: 0 microversion: 2.1 time: 0.172681 Aug 30 07:59:04.342973 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 740/1432] 10.222.0.73 () {58 vars in 1416 bytes} [Mon Aug 30 07:59:04 2021] DELETE /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments/71786385-915c-41c3-9f7b-9e80c4761db0 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:59:04.473110 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e3919e25-ade2-499b-812a-ea5f479dd404 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:04.473802 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e3919e25-ade2-499b-812a-ea5f479dd404 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:04.481628 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3919e25-ade2-499b-812a-ea5f479dd404 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:04.482207 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3919e25-ade2-499b-812a-ea5f479dd404 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:04.483088 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3919e25-ade2-499b-812a-ea5f479dd404 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:04.483625 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3919e25-ade2-499b-812a-ea5f479dd404 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:04.685620 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e3919e25-ade2-499b-812a-ea5f479dd404 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:04.692905 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e3919e25-ade2-499b-812a-ea5f479dd404 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.223483 Aug 30 07:59:04.693465 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 693/1433] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:04 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:04.713063 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-387ba1ea-25c5-487a-b36a-0a011b150f5c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:04.713762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-387ba1ea-25c5-487a-b36a-0a011b150f5c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:04.719833 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-387ba1ea-25c5-487a-b36a-0a011b150f5c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:04.720270 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-387ba1ea-25c5-487a-b36a-0a011b150f5c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:04.721026 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-387ba1ea-25c5-487a-b36a-0a011b150f5c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:04.721458 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-387ba1ea-25c5-487a-b36a-0a011b150f5c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:04.847734 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-387ba1ea-25c5-487a-b36a-0a011b150f5c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:04.856557 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-387ba1ea-25c5-487a-b36a-0a011b150f5c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:04.858196 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-387ba1ea-25c5-487a-b36a-0a011b150f5c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:04.859338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-387ba1ea-25c5-487a-b36a-0a011b150f5c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1673 microversion: 2.20 time: 0.150374 Aug 30 07:59:04.859893 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 741/1434] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:04 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:05.510890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-df1a6aa9-c455-4c17-b5ef-b3946fcc647e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:05.511870 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-df1a6aa9-c455-4c17-b5ef-b3946fcc647e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:05.517631 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df1a6aa9-c455-4c17-b5ef-b3946fcc647e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.518081 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df1a6aa9-c455-4c17-b5ef-b3946fcc647e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:05.518881 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df1a6aa9-c455-4c17-b5ef-b3946fcc647e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.519321 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-df1a6aa9-c455-4c17-b5ef-b3946fcc647e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:05.547691 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-df1a6aa9-c455-4c17-b5ef-b3946fcc647e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040510 Aug 30 07:59:05.548239 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 694/1435] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:59:05 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:59:05.664789 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2bf1b4d3-b1cf-4212-878b-6d4e688ad22a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:05.665796 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2bf1b4d3-b1cf-4212-878b-6d4e688ad22a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:05.671643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2bf1b4d3-b1cf-4212-878b-6d4e688ad22a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.672088 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2bf1b4d3-b1cf-4212-878b-6d4e688ad22a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:05.672844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2bf1b4d3-b1cf-4212-878b-6d4e688ad22a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.673272 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2bf1b4d3-b1cf-4212-878b-6d4e688ad22a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:05.702048 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2bf1b4d3-b1cf-4212-878b-6d4e688ad22a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041025 Aug 30 07:59:05.702794 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 742/1436] 10.222.0.73 () {58 vars in 1302 bytes} [Mon Aug 30 07:59:05 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 07:59:05.708740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-025cb1ca-97fe-4777-9359-4f7d7d91877f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:05.710484 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-025cb1ca-97fe-4777-9359-4f7d7d91877f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:05.716831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-025cb1ca-97fe-4777-9359-4f7d7d91877f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.717282 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-025cb1ca-97fe-4777-9359-4f7d7d91877f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:05.718059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-025cb1ca-97fe-4777-9359-4f7d7d91877f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.718521 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-025cb1ca-97fe-4777-9359-4f7d7d91877f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:05.766677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8a921c88-45f2-4923-9e11-55dd1a65fb2a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:05.767461 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8a921c88-45f2-4923-9e11-55dd1a65fb2a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:05.773763 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8a921c88-45f2-4923-9e11-55dd1a65fb2a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.774454 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8a921c88-45f2-4923-9e11-55dd1a65fb2a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:05.775240 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8a921c88-45f2-4923-9e11-55dd1a65fb2a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.775673 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8a921c88-45f2-4923-9e11-55dd1a65fb2a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:05.801144 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8a921c88-45f2-4923-9e11-55dd1a65fb2a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 07:59:05.848081 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-025cb1ca-97fe-4777-9359-4f7d7d91877f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:05.856911 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-025cb1ca-97fe-4777-9359-4f7d7d91877f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.151895 Aug 30 07:59:05.865825 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 695/1437] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:05 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:59:05.877498 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b23c133a-ff8d-4646-a711-9ffd006c73cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:05.878452 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b23c133a-ff8d-4646-a711-9ffd006c73cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:05.885126 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b23c133a-ff8d-4646-a711-9ffd006c73cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.885652 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b23c133a-ff8d-4646-a711-9ffd006c73cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:05.886749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b23c133a-ff8d-4646-a711-9ffd006c73cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.887418 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b23c133a-ff8d-4646-a711-9ffd006c73cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:05.889626 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8a921c88-45f2-4923-9e11-55dd1a65fb2a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 204 len: 0 microversion: 2.1 time: 0.126448 Aug 30 07:59:05.894229 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 743/1438] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:59:05 2021] DELETE /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 07:59:05.899762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7c9faf1f-65f8-4ed5-a56a-197f6eafa573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:05.900458 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7c9faf1f-65f8-4ed5-a56a-197f6eafa573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:05.906634 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c9faf1f-65f8-4ed5-a56a-197f6eafa573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.907074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c9faf1f-65f8-4ed5-a56a-197f6eafa573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:05.907834 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c9faf1f-65f8-4ed5-a56a-197f6eafa573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:05.908261 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7c9faf1f-65f8-4ed5-a56a-197f6eafa573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:06.012325 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b23c133a-ff8d-4646-a711-9ffd006c73cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:06.019888 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b23c133a-ff8d-4646-a711-9ffd006c73cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:06.021384 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b23c133a-ff8d-4646-a711-9ffd006c73cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:06.023214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b23c133a-ff8d-4646-a711-9ffd006c73cc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.149444 Aug 30 07:59:06.023773 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 696/1439] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:05 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:59:06.030785 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7c9faf1f-65f8-4ed5-a56a-197f6eafa573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:06.038820 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7c9faf1f-65f8-4ed5-a56a-197f6eafa573 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.143543 Aug 30 07:59:06.039363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 744/1440] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:05 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 07:59:06.872618 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b1d6ef87-3523-4e92-af9c-7ae9155722ed tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:06.873247 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b1d6ef87-3523-4e92-af9c-7ae9155722ed tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:06.879108 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b1d6ef87-3523-4e92-af9c-7ae9155722ed tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:06.879558 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b1d6ef87-3523-4e92-af9c-7ae9155722ed tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:06.880360 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b1d6ef87-3523-4e92-af9c-7ae9155722ed tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:06.880801 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b1d6ef87-3523-4e92-af9c-7ae9155722ed tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:07.043432 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9a60574d-bdab-4d3c-931d-8c20c555e020 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:07.044046 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9a60574d-bdab-4d3c-931d-8c20c555e020 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:07.054712 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9a60574d-bdab-4d3c-931d-8c20c555e020 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:07.057873 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b1d6ef87-3523-4e92-af9c-7ae9155722ed tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:07.066878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9a60574d-bdab-4d3c-931d-8c20c555e020 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:07.067703 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9a60574d-bdab-4d3c-931d-8c20c555e020 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:07.067846 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b1d6ef87-3523-4e92-af9c-7ae9155722ed tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.197711 Aug 30 07:59:07.068421 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9a60574d-bdab-4d3c-931d-8c20c555e020 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:07.079499 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 697/1441] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:06 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:07.085237 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4f9ac289-179b-4262-88b4-1368ed6d0d7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:07.086176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4f9ac289-179b-4262-88b4-1368ed6d0d7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:07.093552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f9ac289-179b-4262-88b4-1368ed6d0d7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:07.094372 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f9ac289-179b-4262-88b4-1368ed6d0d7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:07.095403 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f9ac289-179b-4262-88b4-1368ed6d0d7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:07.096066 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4f9ac289-179b-4262-88b4-1368ed6d0d7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:07.280259 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9a60574d-bdab-4d3c-931d-8c20c555e020 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:07.289133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9a60574d-bdab-4d3c-931d-8c20c555e020 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:07.291662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9a60574d-bdab-4d3c-931d-8c20c555e020 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:07.293412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9a60574d-bdab-4d3c-931d-8c20c555e020 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.253333 Aug 30 07:59:07.294169 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 745/1442] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:07 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:59:07.294358 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4f9ac289-179b-4262-88b4-1368ed6d0d7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:07.302486 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4f9ac289-179b-4262-88b4-1368ed6d0d7a tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.221288 Aug 30 07:59:07.303945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 698/1443] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:07 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:08.087391 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-01b0e74c-56c7-4a23-afde-a16e43b25385 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:08.088006 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-01b0e74c-56c7-4a23-afde-a16e43b25385 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:08.093984 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01b0e74c-56c7-4a23-afde-a16e43b25385 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:08.094468 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01b0e74c-56c7-4a23-afde-a16e43b25385 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:08.095252 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01b0e74c-56c7-4a23-afde-a16e43b25385 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:08.095696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-01b0e74c-56c7-4a23-afde-a16e43b25385 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:08.225132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-01b0e74c-56c7-4a23-afde-a16e43b25385 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:08.233340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-01b0e74c-56c7-4a23-afde-a16e43b25385 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.150351 Aug 30 07:59:08.233903 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 746/1444] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:08 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:08.311978 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-76046b13-b6c6-47bb-a6f7-77a2702db672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:08.312659 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-76046b13-b6c6-47bb-a6f7-77a2702db672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:08.319381 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-76046b13-b6c6-47bb-a6f7-77a2702db672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:08.319662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-92046260-bc8a-4d01-bebe-64147dd78e0f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:08.319806 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-76046b13-b6c6-47bb-a6f7-77a2702db672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:08.320574 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-76046b13-b6c6-47bb-a6f7-77a2702db672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:08.320743 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-92046260-bc8a-4d01-bebe-64147dd78e0f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:08.321007 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-76046b13-b6c6-47bb-a6f7-77a2702db672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:08.329048 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-92046260-bc8a-4d01-bebe-64147dd78e0f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:08.329624 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-92046260-bc8a-4d01-bebe-64147dd78e0f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:08.330563 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-92046260-bc8a-4d01-bebe-64147dd78e0f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:08.331092 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-92046260-bc8a-4d01-bebe-64147dd78e0f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:08.463482 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-92046260-bc8a-4d01-bebe-64147dd78e0f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:08.465882 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-76046b13-b6c6-47bb-a6f7-77a2702db672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:08.471769 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-92046260-bc8a-4d01-bebe-64147dd78e0f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.155814 Aug 30 07:59:08.472351 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 747/1445] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:08 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:08.476809 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-76046b13-b6c6-47bb-a6f7-77a2702db672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:08.478288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-76046b13-b6c6-47bb-a6f7-77a2702db672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:08.479859 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-76046b13-b6c6-47bb-a6f7-77a2702db672 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.171536 Aug 30 07:59:08.489990 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 699/1446] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:08 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:09.251643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c5af6f4e-7336-4dfd-82c0-4ff0b92a1ba5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:09.252256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c5af6f4e-7336-4dfd-82c0-4ff0b92a1ba5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:09.258358 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5af6f4e-7336-4dfd-82c0-4ff0b92a1ba5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:09.258806 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5af6f4e-7336-4dfd-82c0-4ff0b92a1ba5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:09.259577 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5af6f4e-7336-4dfd-82c0-4ff0b92a1ba5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:09.260017 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c5af6f4e-7336-4dfd-82c0-4ff0b92a1ba5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:09.388636 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c5af6f4e-7336-4dfd-82c0-4ff0b92a1ba5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:09.396334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c5af6f4e-7336-4dfd-82c0-4ff0b92a1ba5 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.150167 Aug 30 07:59:09.397002 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 748/1447] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:09 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:09.489813 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c704415b-baf1-4f1c-8361-3352b1b7b933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:09.490470 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c704415b-baf1-4f1c-8361-3352b1b7b933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:09.497403 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c704415b-baf1-4f1c-8361-3352b1b7b933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:09.497716 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5952782b-88d5-4b19-9d74-2267273af8bc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:09.497839 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c704415b-baf1-4f1c-8361-3352b1b7b933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:09.498375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5952782b-88d5-4b19-9d74-2267273af8bc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:09.498633 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c704415b-baf1-4f1c-8361-3352b1b7b933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:09.499080 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c704415b-baf1-4f1c-8361-3352b1b7b933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:09.505175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5952782b-88d5-4b19-9d74-2267273af8bc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:09.505626 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5952782b-88d5-4b19-9d74-2267273af8bc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:09.506424 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5952782b-88d5-4b19-9d74-2267273af8bc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:09.507487 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5952782b-88d5-4b19-9d74-2267273af8bc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:09.653518 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c704415b-baf1-4f1c-8361-3352b1b7b933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:09.656222 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5952782b-88d5-4b19-9d74-2267273af8bc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:09.662048 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c704415b-baf1-4f1c-8361-3352b1b7b933 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.175962 Aug 30 07:59:09.663005 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 700/1448] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:09 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:09.668857 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5952782b-88d5-4b19-9d74-2267273af8bc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:09.670412 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5952782b-88d5-4b19-9d74-2267273af8bc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:09.671582 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5952782b-88d5-4b19-9d74-2267273af8bc tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.177541 Aug 30 07:59:09.672150 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 749/1449] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:09 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:59:10.414370 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-93d1fb2d-2117-40dd-99d0-97dd0b1bbe1c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:10.415114 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-93d1fb2d-2117-40dd-99d0-97dd0b1bbe1c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:10.421218 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-93d1fb2d-2117-40dd-99d0-97dd0b1bbe1c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:10.421663 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-93d1fb2d-2117-40dd-99d0-97dd0b1bbe1c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:10.422450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-93d1fb2d-2117-40dd-99d0-97dd0b1bbe1c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:10.422882 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-93d1fb2d-2117-40dd-99d0-97dd0b1bbe1c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:10.560044 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-93d1fb2d-2117-40dd-99d0-97dd0b1bbe1c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:10.572418 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-93d1fb2d-2117-40dd-99d0-97dd0b1bbe1c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.162070 Aug 30 07:59:10.575300 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 701/1450] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:10 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:10.680488 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b6104a94-6877-42d8-aa9c-4b2ef15b4956 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:10.681059 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b6104a94-6877-42d8-aa9c-4b2ef15b4956 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:10.687700 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b6104a94-6877-42d8-aa9c-4b2ef15b4956 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:10.688220 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b6104a94-6877-42d8-aa9c-4b2ef15b4956 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:10.689008 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b6104a94-6877-42d8-aa9c-4b2ef15b4956 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:10.689488 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b6104a94-6877-42d8-aa9c-4b2ef15b4956 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:10.690242 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f36a7d90-d403-4d16-a16e-bf8c9a0bdb16 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:10.690930 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f36a7d90-d403-4d16-a16e-bf8c9a0bdb16 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:10.697370 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f36a7d90-d403-4d16-a16e-bf8c9a0bdb16 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:10.697905 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f36a7d90-d403-4d16-a16e-bf8c9a0bdb16 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:10.698779 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f36a7d90-d403-4d16-a16e-bf8c9a0bdb16 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:10.699283 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f36a7d90-d403-4d16-a16e-bf8c9a0bdb16 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:10.832380 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b6104a94-6877-42d8-aa9c-4b2ef15b4956 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:10.840398 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b6104a94-6877-42d8-aa9c-4b2ef15b4956 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.164832 Aug 30 07:59:10.841606 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 750/1451] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:10 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:10.849259 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f36a7d90-d403-4d16-a16e-bf8c9a0bdb16 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:10.858886 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f36a7d90-d403-4d16-a16e-bf8c9a0bdb16 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:10.860609 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f36a7d90-d403-4d16-a16e-bf8c9a0bdb16 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:10.861781 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f36a7d90-d403-4d16-a16e-bf8c9a0bdb16 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.175567 Aug 30 07:59:10.862362 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 702/1452] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:10 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:11.590437 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fc6a2177-00eb-4f68-b021-7f80f7a094df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:11.591047 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fc6a2177-00eb-4f68-b021-7f80f7a094df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:11.596894 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc6a2177-00eb-4f68-b021-7f80f7a094df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:11.597343 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc6a2177-00eb-4f68-b021-7f80f7a094df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:11.598099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc6a2177-00eb-4f68-b021-7f80f7a094df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:11.598582 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fc6a2177-00eb-4f68-b021-7f80f7a094df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:11.730596 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-fc6a2177-00eb-4f68-b021-7f80f7a094df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:11.738218 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fc6a2177-00eb-4f68-b021-7f80f7a094df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.151376 Aug 30 07:59:11.739230 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 751/1453] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:11 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:11.859097 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-597dcc76-6583-4da9-ba61-352a645e9daf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:11.859732 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-597dcc76-6583-4da9-ba61-352a645e9daf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:11.866022 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-597dcc76-6583-4da9-ba61-352a645e9daf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:11.867004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-597dcc76-6583-4da9-ba61-352a645e9daf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:11.868078 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-597dcc76-6583-4da9-ba61-352a645e9daf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:11.868516 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-597dcc76-6583-4da9-ba61-352a645e9daf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:11.880248 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8aea27b2-8471-4a52-8984-b707f92bfb2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:11.880847 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8aea27b2-8471-4a52-8984-b707f92bfb2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:11.900727 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8aea27b2-8471-4a52-8984-b707f92bfb2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:11.901717 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8aea27b2-8471-4a52-8984-b707f92bfb2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:11.902859 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8aea27b2-8471-4a52-8984-b707f92bfb2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:11.903611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8aea27b2-8471-4a52-8984-b707f92bfb2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:12.005373 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-597dcc76-6583-4da9-ba61-352a645e9daf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:12.016291 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-597dcc76-6583-4da9-ba61-352a645e9daf tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.158062 Aug 30 07:59:12.017585 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 703/1454] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:11 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:12.033338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8aea27b2-8471-4a52-8984-b707f92bfb2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:12.041298 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8aea27b2-8471-4a52-8984-b707f92bfb2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:12.042805 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8aea27b2-8471-4a52-8984-b707f92bfb2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:12.043962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8aea27b2-8471-4a52-8984-b707f92bfb2c tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.167417 Aug 30 07:59:12.044514 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 752/1455] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:11 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:59:12.755981 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-680b20ed-4e5d-4f4f-9ddb-37efc5deb2a0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:12.756656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-680b20ed-4e5d-4f4f-9ddb-37efc5deb2a0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:12.763200 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-680b20ed-4e5d-4f4f-9ddb-37efc5deb2a0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:12.763649 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-680b20ed-4e5d-4f4f-9ddb-37efc5deb2a0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:12.764417 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-680b20ed-4e5d-4f4f-9ddb-37efc5deb2a0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:12.764848 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-680b20ed-4e5d-4f4f-9ddb-37efc5deb2a0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:12.890624 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-680b20ed-4e5d-4f4f-9ddb-37efc5deb2a0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:12.899456 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-680b20ed-4e5d-4f4f-9ddb-37efc5deb2a0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.147224 Aug 30 07:59:12.900041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 704/1456] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:12 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:13.034029 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7f72f8fa-bf82-4336-a1b5-60112ac1c00f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:13.034684 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7f72f8fa-bf82-4336-a1b5-60112ac1c00f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:13.040839 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f72f8fa-bf82-4336-a1b5-60112ac1c00f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:13.041286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f72f8fa-bf82-4336-a1b5-60112ac1c00f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:13.042056 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f72f8fa-bf82-4336-a1b5-60112ac1c00f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:13.042512 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7f72f8fa-bf82-4336-a1b5-60112ac1c00f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:13.062553 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-ffdc1a0f-38cc-4634-b406-5876139ab569 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:13.063183 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-ffdc1a0f-38cc-4634-b406-5876139ab569 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:13.069455 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ffdc1a0f-38cc-4634-b406-5876139ab569 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:13.070428 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ffdc1a0f-38cc-4634-b406-5876139ab569 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:13.071210 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ffdc1a0f-38cc-4634-b406-5876139ab569 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:13.071785 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-ffdc1a0f-38cc-4634-b406-5876139ab569 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:13.172103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7f72f8fa-bf82-4336-a1b5-60112ac1c00f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:13.180153 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7f72f8fa-bf82-4336-a1b5-60112ac1c00f tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.149669 Aug 30 07:59:13.181173 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 753/1457] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:13 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:13.208519 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ffdc1a0f-38cc-4634-b406-5876139ab569 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:13.217437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ffdc1a0f-38cc-4634-b406-5876139ab569 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:13.219018 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-ffdc1a0f-38cc-4634-b406-5876139ab569 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:13.220175 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-ffdc1a0f-38cc-4634-b406-5876139ab569 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.161465 Aug 30 07:59:13.220736 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 705/1458] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:13 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:59:13.916630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-117a065a-8895-4086-8a7c-b228200f0766 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:13.917276 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-117a065a-8895-4086-8a7c-b228200f0766 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:13.923136 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-117a065a-8895-4086-8a7c-b228200f0766 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:13.923583 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-117a065a-8895-4086-8a7c-b228200f0766 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:13.924343 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-117a065a-8895-4086-8a7c-b228200f0766 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:13.924778 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-117a065a-8895-4086-8a7c-b228200f0766 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:14.059220 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-117a065a-8895-4086-8a7c-b228200f0766 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:14.066500 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-117a065a-8895-4086-8a7c-b228200f0766 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.154226 Aug 30 07:59:14.067066 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 754/1459] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:13 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:14.197060 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9667a470-560c-41b7-acbf-a4bca3e11003 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:14.197604 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9667a470-560c-41b7-acbf-a4bca3e11003 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:14.203714 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9667a470-560c-41b7-acbf-a4bca3e11003 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:14.204276 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9667a470-560c-41b7-acbf-a4bca3e11003 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:14.205123 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9667a470-560c-41b7-acbf-a4bca3e11003 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:14.205650 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9667a470-560c-41b7-acbf-a4bca3e11003 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:14.237784 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-f52d7a5b-b05f-4d4f-99b8-34d9011e2c5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:14.238420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-f52d7a5b-b05f-4d4f-99b8-34d9011e2c5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:14.244588 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f52d7a5b-b05f-4d4f-99b8-34d9011e2c5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:14.245036 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f52d7a5b-b05f-4d4f-99b8-34d9011e2c5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:14.245809 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f52d7a5b-b05f-4d4f-99b8-34d9011e2c5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:14.246296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-f52d7a5b-b05f-4d4f-99b8-34d9011e2c5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:14.353740 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9667a470-560c-41b7-acbf-a4bca3e11003 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:14.362171 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9667a470-560c-41b7-acbf-a4bca3e11003 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.169001 Aug 30 07:59:14.362777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 706/1460] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:14 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:14.396691 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f52d7a5b-b05f-4d4f-99b8-34d9011e2c5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:14.405105 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f52d7a5b-b05f-4d4f-99b8-34d9011e2c5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:14.406626 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-f52d7a5b-b05f-4d4f-99b8-34d9011e2c5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:14.407765 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-f52d7a5b-b05f-4d4f-99b8-34d9011e2c5b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.173664 Aug 30 07:59:14.408317 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 755/1461] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:14 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:15.082136 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-89087fc1-ba89-4c59-af82-8ebaaa3e1d2b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:15.082776 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-89087fc1-ba89-4c59-af82-8ebaaa3e1d2b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:15.089065 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-89087fc1-ba89-4c59-af82-8ebaaa3e1d2b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:15.089509 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-89087fc1-ba89-4c59-af82-8ebaaa3e1d2b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:15.090297 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-89087fc1-ba89-4c59-af82-8ebaaa3e1d2b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:15.090725 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-89087fc1-ba89-4c59-af82-8ebaaa3e1d2b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:15.224285 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-89087fc1-ba89-4c59-af82-8ebaaa3e1d2b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:15.233724 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-89087fc1-ba89-4c59-af82-8ebaaa3e1d2b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.155147 Aug 30 07:59:15.234343 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 707/1462] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:15 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:15.379433 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cee24761-cad6-4b92-9b13-1581919d04b6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:15.380141 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-cee24761-cad6-4b92-9b13-1581919d04b6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:15.388318 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cee24761-cad6-4b92-9b13-1581919d04b6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:15.388888 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cee24761-cad6-4b92-9b13-1581919d04b6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:15.389741 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cee24761-cad6-4b92-9b13-1581919d04b6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:15.390211 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-cee24761-cad6-4b92-9b13-1581919d04b6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:15.426397 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-dc573ca2-3130-4e62-87be-7923a17c1d30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:15.427018 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-dc573ca2-3130-4e62-87be-7923a17c1d30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:15.432914 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dc573ca2-3130-4e62-87be-7923a17c1d30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:15.433360 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dc573ca2-3130-4e62-87be-7923a17c1d30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:15.434131 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dc573ca2-3130-4e62-87be-7923a17c1d30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:15.434587 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dc573ca2-3130-4e62-87be-7923a17c1d30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:15.520925 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-cee24761-cad6-4b92-9b13-1581919d04b6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:15.528735 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cee24761-cad6-4b92-9b13-1581919d04b6 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.153184 Aug 30 07:59:15.529684 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 756/1463] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:15 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:15.577277 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-dc573ca2-3130-4e62-87be-7923a17c1d30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:15.585020 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-dc573ca2-3130-4e62-87be-7923a17c1d30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:15.587200 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-dc573ca2-3130-4e62-87be-7923a17c1d30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:15.588339 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-dc573ca2-3130-4e62-87be-7923a17c1d30 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.165678 Aug 30 07:59:15.588900 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 708/1464] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:15 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:16.251654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4580c0c2-7247-4f61-ab8d-bc86d9acbd27 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:16.252181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4580c0c2-7247-4f61-ab8d-bc86d9acbd27 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:16.257988 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4580c0c2-7247-4f61-ab8d-bc86d9acbd27 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:16.259268 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4580c0c2-7247-4f61-ab8d-bc86d9acbd27 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:16.260065 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4580c0c2-7247-4f61-ab8d-bc86d9acbd27 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:16.260497 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4580c0c2-7247-4f61-ab8d-bc86d9acbd27 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:16.386540 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4580c0c2-7247-4f61-ab8d-bc86d9acbd27 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:16.394584 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4580c0c2-7247-4f61-ab8d-bc86d9acbd27 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.146605 Aug 30 07:59:16.395183 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 757/1465] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:16 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:16.544733 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1ed4402a-aae7-4d7c-901c-7ae5e5ad0241 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:16.545275 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1ed4402a-aae7-4d7c-901c-7ae5e5ad0241 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:16.551274 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1ed4402a-aae7-4d7c-901c-7ae5e5ad0241 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:16.551723 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1ed4402a-aae7-4d7c-901c-7ae5e5ad0241 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:16.552490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1ed4402a-aae7-4d7c-901c-7ae5e5ad0241 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:16.552931 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1ed4402a-aae7-4d7c-901c-7ae5e5ad0241 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:16.607216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3f77ad57-be0d-4d7a-aa85-95ba59bacced tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:16.607833 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3f77ad57-be0d-4d7a-aa85-95ba59bacced tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:16.613557 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3f77ad57-be0d-4d7a-aa85-95ba59bacced tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:16.613998 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3f77ad57-be0d-4d7a-aa85-95ba59bacced tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:16.614791 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3f77ad57-be0d-4d7a-aa85-95ba59bacced tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:16.615223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3f77ad57-be0d-4d7a-aa85-95ba59bacced tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:16.677183 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1ed4402a-aae7-4d7c-901c-7ae5e5ad0241 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:16.685098 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1ed4402a-aae7-4d7c-901c-7ae5e5ad0241 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.144076 Aug 30 07:59:16.685676 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 709/1466] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:16 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:16.737278 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3f77ad57-be0d-4d7a-aa85-95ba59bacced tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:16.745581 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3f77ad57-be0d-4d7a-aa85-95ba59bacced tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:16.747098 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3f77ad57-be0d-4d7a-aa85-95ba59bacced tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:16.748228 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3f77ad57-be0d-4d7a-aa85-95ba59bacced tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.145005 Aug 30 07:59:16.748783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 758/1467] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:16 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:59:17.411380 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-39c5e64f-3219-4aa9-96ac-97d21aff23e4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:17.411997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-39c5e64f-3219-4aa9-96ac-97d21aff23e4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:17.418104 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-39c5e64f-3219-4aa9-96ac-97d21aff23e4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:17.418582 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-39c5e64f-3219-4aa9-96ac-97d21aff23e4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:17.419341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-39c5e64f-3219-4aa9-96ac-97d21aff23e4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:17.419777 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-39c5e64f-3219-4aa9-96ac-97d21aff23e4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:17.536926 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-39c5e64f-3219-4aa9-96ac-97d21aff23e4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:17.544252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-39c5e64f-3219-4aa9-96ac-97d21aff23e4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.136598 Aug 30 07:59:17.544815 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 710/1468] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:17 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:17.702756 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0d566153-4922-4ed5-b80c-65707be9c5cd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:17.703300 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0d566153-4922-4ed5-b80c-65707be9c5cd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:17.709243 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d566153-4922-4ed5-b80c-65707be9c5cd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:17.709691 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d566153-4922-4ed5-b80c-65707be9c5cd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:17.710481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d566153-4922-4ed5-b80c-65707be9c5cd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:17.710920 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0d566153-4922-4ed5-b80c-65707be9c5cd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:17.766053 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d8b89c1a-9a0b-4cb4-a3fd-e646f8b0dc1b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:17.766712 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d8b89c1a-9a0b-4cb4-a3fd-e646f8b0dc1b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:17.772403 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8b89c1a-9a0b-4cb4-a3fd-e646f8b0dc1b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:17.772846 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8b89c1a-9a0b-4cb4-a3fd-e646f8b0dc1b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:17.773600 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8b89c1a-9a0b-4cb4-a3fd-e646f8b0dc1b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:17.774062 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8b89c1a-9a0b-4cb4-a3fd-e646f8b0dc1b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:17.833135 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0d566153-4922-4ed5-b80c-65707be9c5cd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:17.840961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0d566153-4922-4ed5-b80c-65707be9c5cd tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.142027 Aug 30 07:59:17.841653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 759/1469] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:17 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:17.901727 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d8b89c1a-9a0b-4cb4-a3fd-e646f8b0dc1b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:17.909334 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d8b89c1a-9a0b-4cb4-a3fd-e646f8b0dc1b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:17.910866 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d8b89c1a-9a0b-4cb4-a3fd-e646f8b0dc1b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:17.911978 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d8b89c1a-9a0b-4cb4-a3fd-e646f8b0dc1b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.149751 Aug 30 07:59:17.912523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 711/1470] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:17 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:59:18.560541 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-89f321fe-924a-45c2-9e75-2e7f341e3f8b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:18.561186 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-89f321fe-924a-45c2-9e75-2e7f341e3f8b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:18.567051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89f321fe-924a-45c2-9e75-2e7f341e3f8b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:18.567500 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89f321fe-924a-45c2-9e75-2e7f341e3f8b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:18.568263 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89f321fe-924a-45c2-9e75-2e7f341e3f8b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:18.568703 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-89f321fe-924a-45c2-9e75-2e7f341e3f8b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:18.690664 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-89f321fe-924a-45c2-9e75-2e7f341e3f8b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:18.697926 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-89f321fe-924a-45c2-9e75-2e7f341e3f8b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.141051 Aug 30 07:59:18.698517 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 760/1471] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:18 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:18.858832 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8193a3ed-72e3-435f-9049-4a6f38d96c56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:18.859447 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8193a3ed-72e3-435f-9049-4a6f38d96c56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:18.865262 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8193a3ed-72e3-435f-9049-4a6f38d96c56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:18.865711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8193a3ed-72e3-435f-9049-4a6f38d96c56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:18.866538 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8193a3ed-72e3-435f-9049-4a6f38d96c56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:18.866974 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8193a3ed-72e3-435f-9049-4a6f38d96c56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:18.930066 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e6f0b170-0987-4ea5-849a-7347217dd622 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:18.930699 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e6f0b170-0987-4ea5-849a-7347217dd622 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:18.936633 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6f0b170-0987-4ea5-849a-7347217dd622 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:18.937077 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6f0b170-0987-4ea5-849a-7347217dd622 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:18.937915 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6f0b170-0987-4ea5-849a-7347217dd622 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:18.938382 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e6f0b170-0987-4ea5-849a-7347217dd622 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:18.987603 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8193a3ed-72e3-435f-9049-4a6f38d96c56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:18.995077 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8193a3ed-72e3-435f-9049-4a6f38d96c56 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.140099 Aug 30 07:59:18.995834 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 712/1472] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:18 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:19.061130 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e6f0b170-0987-4ea5-849a-7347217dd622 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:19.068706 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e6f0b170-0987-4ea5-849a-7347217dd622 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:19.070216 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e6f0b170-0987-4ea5-849a-7347217dd622 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:19.071345 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e6f0b170-0987-4ea5-849a-7347217dd622 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.145067 Aug 30 07:59:19.071889 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 761/1473] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:18 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:19.715119 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f2b6a810-e8e0-495d-8de6-65e8aa4ad984 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:19.715733 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f2b6a810-e8e0-495d-8de6-65e8aa4ad984 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:19.721567 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2b6a810-e8e0-495d-8de6-65e8aa4ad984 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:19.722037 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2b6a810-e8e0-495d-8de6-65e8aa4ad984 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:19.722821 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2b6a810-e8e0-495d-8de6-65e8aa4ad984 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:19.723244 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f2b6a810-e8e0-495d-8de6-65e8aa4ad984 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:19.842102 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f2b6a810-e8e0-495d-8de6-65e8aa4ad984 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:19.849232 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f2b6a810-e8e0-495d-8de6-65e8aa4ad984 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.138446 Aug 30 07:59:19.849787 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 713/1474] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:19 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:20.012754 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dc2c1abe-e9b5-4d5d-be27-0509896d67ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:20.013367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dc2c1abe-e9b5-4d5d-be27-0509896d67ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:20.019246 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dc2c1abe-e9b5-4d5d-be27-0509896d67ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:20.019695 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dc2c1abe-e9b5-4d5d-be27-0509896d67ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:20.020450 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dc2c1abe-e9b5-4d5d-be27-0509896d67ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:20.020885 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dc2c1abe-e9b5-4d5d-be27-0509896d67ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:20.088685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e48aa3a9-81c6-4ca5-825e-0ae2d618aa05 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:20.089309 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e48aa3a9-81c6-4ca5-825e-0ae2d618aa05 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:20.095044 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e48aa3a9-81c6-4ca5-825e-0ae2d618aa05 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:20.095489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e48aa3a9-81c6-4ca5-825e-0ae2d618aa05 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:20.096242 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e48aa3a9-81c6-4ca5-825e-0ae2d618aa05 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:20.096671 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e48aa3a9-81c6-4ca5-825e-0ae2d618aa05 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:20.140296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-dc2c1abe-e9b5-4d5d-be27-0509896d67ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:20.147518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dc2c1abe-e9b5-4d5d-be27-0509896d67ae tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.139271 Aug 30 07:59:20.148078 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 762/1475] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:20 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:20.225386 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e48aa3a9-81c6-4ca5-825e-0ae2d618aa05 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:20.233397 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e48aa3a9-81c6-4ca5-825e-0ae2d618aa05 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:20.234924 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e48aa3a9-81c6-4ca5-825e-0ae2d618aa05 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:20.236053 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e48aa3a9-81c6-4ca5-825e-0ae2d618aa05 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.151205 Aug 30 07:59:20.236610 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 714/1476] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:20 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:59:20.866199 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c08b4f74-0535-42f8-8a22-8ea9d50b8b68 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:20.866817 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c08b4f74-0535-42f8-8a22-8ea9d50b8b68 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:20.872636 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c08b4f74-0535-42f8-8a22-8ea9d50b8b68 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:20.873082 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c08b4f74-0535-42f8-8a22-8ea9d50b8b68 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:20.873841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c08b4f74-0535-42f8-8a22-8ea9d50b8b68 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:20.874298 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c08b4f74-0535-42f8-8a22-8ea9d50b8b68 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:20.999766 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c08b4f74-0535-42f8-8a22-8ea9d50b8b68 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:21.007051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c08b4f74-0535-42f8-8a22-8ea9d50b8b68 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.144566 Aug 30 07:59:21.007631 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 763/1477] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:20 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:21.164552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4a85925b-d570-4ab0-9baa-4bec760c037b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:21.165176 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4a85925b-d570-4ab0-9baa-4bec760c037b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:21.171433 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4a85925b-d570-4ab0-9baa-4bec760c037b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:21.171889 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4a85925b-d570-4ab0-9baa-4bec760c037b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:21.172658 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4a85925b-d570-4ab0-9baa-4bec760c037b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:21.173100 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4a85925b-d570-4ab0-9baa-4bec760c037b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:21.254873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-de040aa6-58bb-4fea-a110-dc6042fd9913 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:21.255503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-de040aa6-58bb-4fea-a110-dc6042fd9913 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:21.262356 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de040aa6-58bb-4fea-a110-dc6042fd9913 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:21.262803 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de040aa6-58bb-4fea-a110-dc6042fd9913 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:21.263573 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de040aa6-58bb-4fea-a110-dc6042fd9913 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:21.264003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-de040aa6-58bb-4fea-a110-dc6042fd9913 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:21.390487 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-de040aa6-58bb-4fea-a110-dc6042fd9913 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:21.398811 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-de040aa6-58bb-4fea-a110-dc6042fd9913 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:21.400886 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-de040aa6-58bb-4fea-a110-dc6042fd9913 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:21.402114 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-de040aa6-58bb-4fea-a110-dc6042fd9913 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.150983 Aug 30 07:59:21.402716 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 764/1478] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:21 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 07:59:21.608314 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-4a85925b-d570-4ab0-9baa-4bec760c037b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:21.615581 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4a85925b-d570-4ab0-9baa-4bec760c037b tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1673 microversion: 2.1 time: 0.454676 Aug 30 07:59:21.616229 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 715/1479] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:21 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1673 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:22.024067 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-20e957ac-ee6d-4894-b82f-9afe5ec5fd67 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:22.024845 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-20e957ac-ee6d-4894-b82f-9afe5ec5fd67 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:22.030586 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20e957ac-ee6d-4894-b82f-9afe5ec5fd67 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:22.031058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20e957ac-ee6d-4894-b82f-9afe5ec5fd67 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:22.031822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20e957ac-ee6d-4894-b82f-9afe5ec5fd67 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:22.032250 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-20e957ac-ee6d-4894-b82f-9afe5ec5fd67 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:22.152880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-20e957ac-ee6d-4894-b82f-9afe5ec5fd67 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:22.160174 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-20e957ac-ee6d-4894-b82f-9afe5ec5fd67 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.139821 Aug 30 07:59:22.160732 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 765/1480] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:22 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:22.312059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-544e560c-2f25-4328-b136-277b15b48685 req-448a9b5c-dcad-4048-85e8-29ec501c61d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb1895f-02c2-4252-a5ba-f3c6496dfa4d", "name": "network-vif-deleted", "tag": "fe883039-4227-47ba-89b3-d8497a08c086"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:59:22.313638 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:59:22.313638 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:59:22.321829 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-544e560c-2f25-4328-b136-277b15b48685 req-448a9b5c-dcad-4048-85e8-29ec501c61d3 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:22.322843 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-544e560c-2f25-4328-b136-277b15b48685 req-448a9b5c-dcad-4048-85e8-29ec501c61d3 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:22.335840 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-544e560c-2f25-4328-b136-277b15b48685 req-448a9b5c-dcad-4048-85e8-29ec501c61d3 service nova] Creating event network-vif-deleted:fe883039-4227-47ba-89b3-d8497a08c086 for instance 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d on hv-cinder-80619 Aug 30 07:59:22.342187 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-544e560c-2f25-4328-b136-277b15b48685 req-448a9b5c-dcad-4048-85e8-29ec501c61d3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095749 Aug 30 07:59:22.343487 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 716/1481] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:59:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:59:22.421132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-10c2ccbf-56bc-4aee-bb5c-8ea151bb0744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:22.421759 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-10c2ccbf-56bc-4aee-bb5c-8ea151bb0744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:22.427656 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-10c2ccbf-56bc-4aee-bb5c-8ea151bb0744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:22.428263 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-10c2ccbf-56bc-4aee-bb5c-8ea151bb0744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:22.429040 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-10c2ccbf-56bc-4aee-bb5c-8ea151bb0744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:22.429471 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-10c2ccbf-56bc-4aee-bb5c-8ea151bb0744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:22.558419 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-10c2ccbf-56bc-4aee-bb5c-8ea151bb0744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:22.566111 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-10c2ccbf-56bc-4aee-bb5c-8ea151bb0744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:22.567632 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-10c2ccbf-56bc-4aee-bb5c-8ea151bb0744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:22.568784 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-10c2ccbf-56bc-4aee-bb5c-8ea151bb0744 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.151556 Aug 30 07:59:22.569338 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 766/1482] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:22 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:22.634695 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-41dff886-ab66-402f-bbab-d00db8f06163 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:22.635405 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-41dff886-ab66-402f-bbab-d00db8f06163 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:22.641359 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41dff886-ab66-402f-bbab-d00db8f06163 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:22.641806 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41dff886-ab66-402f-bbab-d00db8f06163 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:22.642598 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41dff886-ab66-402f-bbab-d00db8f06163 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:22.643035 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41dff886-ab66-402f-bbab-d00db8f06163 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:22.673039 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41dff886-ab66-402f-bbab-d00db8f06163 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:22.673484 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-41dff886-ab66-402f-bbab-d00db8f06163 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:22.673928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-41dff886-ab66-402f-bbab-d00db8f06163 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lazy-loading 'fault' on Instance uuid 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 07:59:22.716883 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-41dff886-ab66-402f-bbab-d00db8f06163 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8eae3157f0344a6b8fe600144708a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71ca0134bc64db3b85a744bc5da948c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:22.724074 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-41dff886-ab66-402f-bbab-d00db8f06163 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 200 len: 1327 microversion: 2.1 time: 0.093554 Aug 30 07:59:22.724645 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 717/1483] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:22 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:23.177970 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-78207c7c-ecc9-451e-8bb2-c11d1189d0d6 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:23.178521 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-78207c7c-ecc9-451e-8bb2-c11d1189d0d6 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:23.184397 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78207c7c-ecc9-451e-8bb2-c11d1189d0d6 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:23.184875 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78207c7c-ecc9-451e-8bb2-c11d1189d0d6 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:23.185640 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78207c7c-ecc9-451e-8bb2-c11d1189d0d6 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:23.186071 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-78207c7c-ecc9-451e-8bb2-c11d1189d0d6 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:23.309179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-78207c7c-ecc9-451e-8bb2-c11d1189d0d6 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:23.316419 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-78207c7c-ecc9-451e-8bb2-c11d1189d0d6 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.142322 Aug 30 07:59:23.316985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 767/1484] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:23 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:23.588623 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-38fa22ee-8e4f-4584-bdcd-500eb9984420 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:23.589195 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-38fa22ee-8e4f-4584-bdcd-500eb9984420 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:23.595233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-38fa22ee-8e4f-4584-bdcd-500eb9984420 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:23.595688 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-38fa22ee-8e4f-4584-bdcd-500eb9984420 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:23.596464 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-38fa22ee-8e4f-4584-bdcd-500eb9984420 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:23.596902 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-38fa22ee-8e4f-4584-bdcd-500eb9984420 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:23.717828 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-38fa22ee-8e4f-4584-bdcd-500eb9984420 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:23.725730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-38fa22ee-8e4f-4584-bdcd-500eb9984420 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:23.727268 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-38fa22ee-8e4f-4584-bdcd-500eb9984420 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:23.728461 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-38fa22ee-8e4f-4584-bdcd-500eb9984420 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.144326 Aug 30 07:59:23.729027 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 718/1485] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:23 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:23.741805 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-23b7563b-b2f4-442e-91e7-d696f57f6b2c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:23.742587 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-23b7563b-b2f4-442e-91e7-d696f57f6b2c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:23.749405 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-23b7563b-b2f4-442e-91e7-d696f57f6b2c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:23.749862 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-23b7563b-b2f4-442e-91e7-d696f57f6b2c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:23.750684 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-23b7563b-b2f4-442e-91e7-d696f57f6b2c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:23.751121 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-23b7563b-b2f4-442e-91e7-d696f57f6b2c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:23.765629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-23b7563b-b2f4-442e-91e7-d696f57f6b2c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] HTTP exception thrown: Instance 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d could not be found. Aug 30 07:59:23.766294 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-23b7563b-b2f4-442e-91e7-d696f57f6b2c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Returning 404 to user: Instance 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:59:23.767125 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-23b7563b-b2f4-442e-91e7-d696f57f6b2c tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 404 len: 111 microversion: 2.1 time: 0.029043 Aug 30 07:59:23.767668 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 768/1486] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:23 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 07:59:23.776792 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4da00581-8d92-45df-b7cb-7f6b5bdccdd5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '.version_select at 0x7f341c14cf70>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:23.794095 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4da00581-8d92-45df-b7cb-7f6b5bdccdd5 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217063246" status: 202 len: 0 microversion: 2.1 time: 0.021762 Aug 30 07:59:23.794697 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 719/1487] 10.222.0.73 () {58 vars in 1221 bytes} [Mon Aug 30 07:59:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217063246 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 07:59:24.332935 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-33f9499a-c958-4e99-b788-4c161f866d42 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:24.333819 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-33f9499a-c958-4e99-b788-4c161f866d42 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:24.340177 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-33f9499a-c958-4e99-b788-4c161f866d42 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:24.340821 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-33f9499a-c958-4e99-b788-4c161f866d42 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:24.341610 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-33f9499a-c958-4e99-b788-4c161f866d42 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:24.342396 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-33f9499a-c958-4e99-b788-4c161f866d42 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:24.484279 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-33f9499a-c958-4e99-b788-4c161f866d42 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:24.491660 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-33f9499a-c958-4e99-b788-4c161f866d42 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.162637 Aug 30 07:59:24.492311 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 769/1488] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:24 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:24.747254 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-57c1330c-6335-4417-b3cd-9ed45dc9a9fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:24.747863 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-57c1330c-6335-4417-b3cd-9ed45dc9a9fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:24.753589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-57c1330c-6335-4417-b3cd-9ed45dc9a9fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:24.754040 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-57c1330c-6335-4417-b3cd-9ed45dc9a9fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:24.754842 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-57c1330c-6335-4417-b3cd-9ed45dc9a9fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:24.755287 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-57c1330c-6335-4417-b3cd-9ed45dc9a9fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:24.883644 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-57c1330c-6335-4417-b3cd-9ed45dc9a9fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:24.892163 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-57c1330c-6335-4417-b3cd-9ed45dc9a9fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:24.893666 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-57c1330c-6335-4417-b3cd-9ed45dc9a9fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:24.894866 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-57c1330c-6335-4417-b3cd-9ed45dc9a9fa tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.151412 Aug 30 07:59:24.895424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 720/1489] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:24 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:25.476326 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-9ad575e2-f8b3-46de-875a-e98455baeb77 req-002702d4-cf9c-40d0-a474-ac9716e817f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7a4654-a0be-4fa9-b45b-acbd7ba764e9", "name": "network-vif-plugged", "status": "completed", "tag": "df6e2650-791e-4b79-8911-dc23e2079687"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:59:25.478168 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:59:25.478168 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:59:25.486731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-9ad575e2-f8b3-46de-875a-e98455baeb77 req-002702d4-cf9c-40d0-a474-ac9716e817f9 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:25.487364 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-9ad575e2-f8b3-46de-875a-e98455baeb77 req-002702d4-cf9c-40d0-a474-ac9716e817f9 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:25.503494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-9ad575e2-f8b3-46de-875a-e98455baeb77 req-002702d4-cf9c-40d0-a474-ac9716e817f9 service nova] Creating event network-vif-plugged:df6e2650-791e-4b79-8911-dc23e2079687 for instance 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 on hv-cinder-80619 Aug 30 07:59:25.508772 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-9ad575e2-f8b3-46de-875a-e98455baeb77 req-002702d4-cf9c-40d0-a474-ac9716e817f9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035958 Aug 30 07:59:25.510140 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 770/1490] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:59:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:59:25.512523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cb6aec20-8d2f-4518-b74d-2dbf01ada8b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:25.513157 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-cb6aec20-8d2f-4518-b74d-2dbf01ada8b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:25.520407 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cb6aec20-8d2f-4518-b74d-2dbf01ada8b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:25.520869 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cb6aec20-8d2f-4518-b74d-2dbf01ada8b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:25.521656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cb6aec20-8d2f-4518-b74d-2dbf01ada8b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:25.522097 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cb6aec20-8d2f-4518-b74d-2dbf01ada8b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:25.673489 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-cb6aec20-8d2f-4518-b74d-2dbf01ada8b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:25.682098 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-cb6aec20-8d2f-4518-b74d-2dbf01ada8b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.173733 Aug 30 07:59:25.683530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 721/1491] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:25 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:25.913242 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-346c9f58-6c3e-4b34-8b85-a618a835d9b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:25.914072 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-346c9f58-6c3e-4b34-8b85-a618a835d9b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:25.920240 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-346c9f58-6c3e-4b34-8b85-a618a835d9b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:25.920686 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-346c9f58-6c3e-4b34-8b85-a618a835d9b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:25.921448 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-346c9f58-6c3e-4b34-8b85-a618a835d9b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:25.921880 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-346c9f58-6c3e-4b34-8b85-a618a835d9b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:26.046175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-346c9f58-6c3e-4b34-8b85-a618a835d9b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:26.053933 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-346c9f58-6c3e-4b34-8b85-a618a835d9b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:26.055481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-346c9f58-6c3e-4b34-8b85-a618a835d9b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:26.057695 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-346c9f58-6c3e-4b34-8b85-a618a835d9b7 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.147455 Aug 30 07:59:26.058290 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 771/1492] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:25 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:26.699197 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-feaeff19-b5ca-430f-ae72-a18683bc9d93 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:26.699959 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-feaeff19-b5ca-430f-ae72-a18683bc9d93 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:26.705778 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-feaeff19-b5ca-430f-ae72-a18683bc9d93 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:26.706327 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-feaeff19-b5ca-430f-ae72-a18683bc9d93 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:26.707088 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-feaeff19-b5ca-430f-ae72-a18683bc9d93 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:26.707517 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-feaeff19-b5ca-430f-ae72-a18683bc9d93 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:26.752747 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8de398b7-f60b-447a-856f-17986c578db7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:26.753282 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8de398b7-f60b-447a-856f-17986c578db7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:26.759099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8de398b7-f60b-447a-856f-17986c578db7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:26.759541 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8de398b7-f60b-447a-856f-17986c578db7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:26.760381 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8de398b7-f60b-447a-856f-17986c578db7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:26.760813 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8de398b7-f60b-447a-856f-17986c578db7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:26.774961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-8de398b7-f60b-447a-856f-17986c578db7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] HTTP exception thrown: Instance 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d could not be found. Aug 30 07:59:26.776558 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8de398b7-f60b-447a-856f-17986c578db7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Returning 404 to user: Instance 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:59:26.777277 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8de398b7-f60b-447a-856f-17986c578db7 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 404 len: 111 microversion: 2.1 time: 0.028215 Aug 30 07:59:26.777822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 772/1493] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:59:26 2021] DELETE /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:59:26.785458 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-36da9cfa-c408-4497-bec6-b459fbfeb59d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:26.786071 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-36da9cfa-c408-4497-bec6-b459fbfeb59d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:26.793035 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-36da9cfa-c408-4497-bec6-b459fbfeb59d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:26.793492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-36da9cfa-c408-4497-bec6-b459fbfeb59d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:26.794308 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-36da9cfa-c408-4497-bec6-b459fbfeb59d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:26.794746 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-36da9cfa-c408-4497-bec6-b459fbfeb59d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:26.808494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-36da9cfa-c408-4497-bec6-b459fbfeb59d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] HTTP exception thrown: Instance 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d could not be found. Aug 30 07:59:26.809085 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-36da9cfa-c408-4497-bec6-b459fbfeb59d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Returning 404 to user: Instance 6eb1895f-02c2-4252-a5ba-f3c6496dfa4d could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:59:26.809923 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-36da9cfa-c408-4497-bec6-b459fbfeb59d tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d" status: 404 len: 111 microversion: 2.1 time: 0.027991 Aug 30 07:59:26.810486 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 773/1494] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:26 2021] GET /compute/v2.1/servers/6eb1895f-02c2-4252-a5ba-f3c6496dfa4d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:59:26.831436 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-feaeff19-b5ca-430f-ae72-a18683bc9d93 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:26.839542 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-feaeff19-b5ca-430f-ae72-a18683bc9d93 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1259 microversion: 2.1 time: 0.144060 Aug 30 07:59:26.840122 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 722/1495] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:26 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:27.076373 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-fe4ef92f-9802-4a16-b0f4-d693262df715 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:27.077051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-fe4ef92f-9802-4a16-b0f4-d693262df715 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:27.082784 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe4ef92f-9802-4a16-b0f4-d693262df715 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:27.083227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe4ef92f-9802-4a16-b0f4-d693262df715 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:27.084036 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe4ef92f-9802-4a16-b0f4-d693262df715 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:27.084479 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-fe4ef92f-9802-4a16-b0f4-d693262df715 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:27.211724 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-fe4ef92f-9802-4a16-b0f4-d693262df715 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:27.220099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-fe4ef92f-9802-4a16-b0f4-d693262df715 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:27.221534 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-fe4ef92f-9802-4a16-b0f4-d693262df715 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:27.222705 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-fe4ef92f-9802-4a16-b0f4-d693262df715 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.150890 Aug 30 07:59:27.223257 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 774/1496] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:27 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:27.540504 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-ec677555-aa76-4881-b4e4-dac92cfbe7d3 req-da7a91b0-b832-4085-8661-b71ba52c63f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bba115-ffa4-48f5-9f97-30c8117579c2", "name": "network-vif-plugged", "status": "completed", "tag": "433de034-350e-4435-8de8-087595037325"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:59:27.542711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:59:27.542711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 07:59:27.549463 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-ec677555-aa76-4881-b4e4-dac92cfbe7d3 req-da7a91b0-b832-4085-8661-b71ba52c63f2 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:27.549910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-ec677555-aa76-4881-b4e4-dac92cfbe7d3 req-da7a91b0-b832-4085-8661-b71ba52c63f2 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:27.560563 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-ec677555-aa76-4881-b4e4-dac92cfbe7d3 req-da7a91b0-b832-4085-8661-b71ba52c63f2 service nova] Creating event network-vif-plugged:433de034-350e-4435-8de8-087595037325 for instance 04bba115-ffa4-48f5-9f97-30c8117579c2 on hv-cinder-80619 Aug 30 07:59:27.565450 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-ec677555-aa76-4881-b4e4-dac92cfbe7d3 req-da7a91b0-b832-4085-8661-b71ba52c63f2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028618 Aug 30 07:59:27.566008 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 723/1497] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:59:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 07:59:27.857734 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-37ed668b-18c6-4e3e-b3dc-b10789ca384a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:27.858398 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-37ed668b-18c6-4e3e-b3dc-b10789ca384a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:27.864116 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37ed668b-18c6-4e3e-b3dc-b10789ca384a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:27.864564 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37ed668b-18c6-4e3e-b3dc-b10789ca384a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:27.865326 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37ed668b-18c6-4e3e-b3dc-b10789ca384a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:27.865762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-37ed668b-18c6-4e3e-b3dc-b10789ca384a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:27.940822 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-59a05542-3f1c-4e82-900b-02bd82afcf74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:27.941408 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-59a05542-3f1c-4e82-900b-02bd82afcf74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:27.947568 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59a05542-3f1c-4e82-900b-02bd82afcf74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:27.948025 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59a05542-3f1c-4e82-900b-02bd82afcf74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:27.948813 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59a05542-3f1c-4e82-900b-02bd82afcf74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:27.949235 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-59a05542-3f1c-4e82-900b-02bd82afcf74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:27.964490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-59a05542-3f1c-4e82-900b-02bd82afcf74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] HTTP exception thrown: Instance 63042c8c-43ca-4d02-8ef2-07a08833cdf1 could not be found. Aug 30 07:59:27.965094 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-59a05542-3f1c-4e82-900b-02bd82afcf74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Returning 404 to user: Instance 63042c8c-43ca-4d02-8ef2-07a08833cdf1 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:59:27.965934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-59a05542-3f1c-4e82-900b-02bd82afcf74 tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "DELETE /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 404 len: 111 microversion: 2.1 time: 0.029139 Aug 30 07:59:27.966737 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 724/1498] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 07:59:27 2021] DELETE /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:59:27.974203 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-92689588-d6a1-45a9-a420-2c50eb36822e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:27.974822 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-92689588-d6a1-45a9-a420-2c50eb36822e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] [instance: 63042c8c-43ca-4d02-8ef2-07a08833cdf1] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:27.981325 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92689588-d6a1-45a9-a420-2c50eb36822e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:27.982043 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92689588-d6a1-45a9-a420-2c50eb36822e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:27.982967 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92689588-d6a1-45a9-a420-2c50eb36822e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:27.983410 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-92689588-d6a1-45a9-a420-2c50eb36822e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:27.992293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-37ed668b-18c6-4e3e-b3dc-b10789ca384a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:27.997268 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-92689588-d6a1-45a9-a420-2c50eb36822e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] HTTP exception thrown: Instance 63042c8c-43ca-4d02-8ef2-07a08833cdf1 could not be found. Aug 30 07:59:27.997863 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-92689588-d6a1-45a9-a420-2c50eb36822e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] Returning 404 to user: Instance 63042c8c-43ca-4d02-8ef2-07a08833cdf1 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:59:27.998719 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-92689588-d6a1-45a9-a420-2c50eb36822e tempest-AttachVolumeTestJSON-1578313864 tempest-AttachVolumeTestJSON-1578313864-project] 10.222.0.73 "GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1" status: 404 len: 111 microversion: 2.1 time: 0.027979 Aug 30 07:59:27.999255 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 725/1499] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:27 2021] GET /compute/v2.1/servers/63042c8c-43ca-4d02-8ef2-07a08833cdf1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:59:28.000605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-37ed668b-18c6-4e3e-b3dc-b10789ca384a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1442 microversion: 2.1 time: 0.147517 Aug 30 07:59:28.001165 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 775/1500] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:27 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1442 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:28.016288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a9c93811-623e-46e6-9d09-5e61917329bf tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:28.016909 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a9c93811-623e-46e6-9d09-5e61917329bf tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:28.022735 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a9c93811-623e-46e6-9d09-5e61917329bf tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:28.023185 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a9c93811-623e-46e6-9d09-5e61917329bf tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:28.023951 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a9c93811-623e-46e6-9d09-5e61917329bf tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:28.024391 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a9c93811-623e-46e6-9d09-5e61917329bf tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:28.146855 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a9c93811-623e-46e6-9d09-5e61917329bf tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:28.154276 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a9c93811-623e-46e6-9d09-5e61917329bf tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1442 microversion: 2.1 time: 0.141572 Aug 30 07:59:28.154841 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 726/1501] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 07:59:28 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1442 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 07:59:28.240997 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-03088594-4218-4b94-bddc-38c164a6430d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:28.241607 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-03088594-4218-4b94-bddc-38c164a6430d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:28.247597 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-03088594-4218-4b94-bddc-38c164a6430d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:28.248499 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-03088594-4218-4b94-bddc-38c164a6430d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:28.249283 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-03088594-4218-4b94-bddc-38c164a6430d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:28.249978 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-03088594-4218-4b94-bddc-38c164a6430d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:28.435497 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-03088594-4218-4b94-bddc-38c164a6430d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:28.444498 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-03088594-4218-4b94-bddc-38c164a6430d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:28.446020 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-03088594-4218-4b94-bddc-38c164a6430d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:28.447229 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-03088594-4218-4b94-bddc-38c164a6430d tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.209966 Aug 30 07:59:28.448114 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 776/1502] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:28 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:29.465989 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9f86dc2f-d42d-4e14-b8cb-8a3f08791957 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:29.467334 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9f86dc2f-d42d-4e14-b8cb-8a3f08791957 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:29.484260 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9f86dc2f-d42d-4e14-b8cb-8a3f08791957 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:29.484998 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9f86dc2f-d42d-4e14-b8cb-8a3f08791957 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:29.488424 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9f86dc2f-d42d-4e14-b8cb-8a3f08791957 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:29.488831 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9f86dc2f-d42d-4e14-b8cb-8a3f08791957 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:29.730976 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9f86dc2f-d42d-4e14-b8cb-8a3f08791957 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:29.742498 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9f86dc2f-d42d-4e14-b8cb-8a3f08791957 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:29.744012 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9f86dc2f-d42d-4e14-b8cb-8a3f08791957 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:29.745456 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9f86dc2f-d42d-4e14-b8cb-8a3f08791957 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1731 microversion: 2.20 time: 0.283810 Aug 30 07:59:29.746034 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 727/1503] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:29 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1731 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:30.089129 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-3597326f-e134-4593-82c3-17695ebf0fec req-da70e170-a3b6-4a41-8a73-b0f4448fa735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f7a4654-a0be-4fa9-b45b-acbd7ba764e9", "tag": "df6e2650-791e-4b79-8911-dc23e2079687"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:59:30.090719 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 07:59:30.090719 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 07:59:30.101883 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-3597326f-e134-4593-82c3-17695ebf0fec req-da70e170-a3b6-4a41-8a73-b0f4448fa735 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:30.102348 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-3597326f-e134-4593-82c3-17695ebf0fec req-da70e170-a3b6-4a41-8a73-b0f4448fa735 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:30.113963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-3597326f-e134-4593-82c3-17695ebf0fec req-da70e170-a3b6-4a41-8a73-b0f4448fa735 service nova] Creating event network-changed:df6e2650-791e-4b79-8911-dc23e2079687 for instance 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 on hv-cinder-80619 Aug 30 07:59:30.119679 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-3597326f-e134-4593-82c3-17695ebf0fec req-da70e170-a3b6-4a41-8a73-b0f4448fa735 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035067 Aug 30 07:59:30.120679 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 777/1504] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 07:59:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 07:59:30.762910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3bae979b-fe89-4b7b-acbb-4a9aac6c402a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:30.764252 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3bae979b-fe89-4b7b-acbb-4a9aac6c402a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 07:59:30.771547 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3bae979b-fe89-4b7b-acbb-4a9aac6c402a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:30.771991 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3bae979b-fe89-4b7b-acbb-4a9aac6c402a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:30.772767 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3bae979b-fe89-4b7b-acbb-4a9aac6c402a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 07:59:30.773202 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3bae979b-fe89-4b7b-acbb-4a9aac6c402a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 07:59:30.909588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3bae979b-fe89-4b7b-acbb-4a9aac6c402a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:30.923664 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3bae979b-fe89-4b7b-acbb-4a9aac6c402a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:30.926217 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3bae979b-fe89-4b7b-acbb-4a9aac6c402a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 07:59:30.928368 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3bae979b-fe89-4b7b-acbb-4a9aac6c402a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1718 microversion: 2.20 time: 0.168899 Aug 30 07:59:30.942770 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 728/1505] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 07:59:30 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1718 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 07:59:32.734221 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-77f0e2c6-1697-49a6-873a-0dfb33253ff3 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Action: 'create', calling method: .version_select at 0x7f341c145af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-583197708", "metadata": {"Type": "work"}}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:59:32.735643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-77f0e2c6-1697-49a6-873a-0dfb33253ff3 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:59:32.736484 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-77f0e2c6-1697-49a6-873a-0dfb33253ff3 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.112832 Aug 30 07:59:32.736996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 778/1506] 10.222.0.73 () {60 vars in 1156 bytes} [Mon Aug 30 07:59:32 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 07:59:32.746091 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f4920b11-5ada-4188-b5d7-17d0a5a23eb6 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Action: 'create', calling method: .version_select at 0x7f341c14c9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1381651279", "metadata": {"Type": "work"}}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:59:32.747557 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f4920b11-5ada-4188-b5d7-17d0a5a23eb6 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:59:32.748388 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f4920b11-5ada-4188-b5d7-17d0a5a23eb6 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006050 Aug 30 07:59:32.748892 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 729/1507] 10.222.0.73 () {60 vars in 1156 bytes} [Mon Aug 30 07:59:32 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 07:59:32.756706 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9d411785-ad16-4e3a-972f-ab3926711e2a tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Action: 'create', calling method: .version_select at 0x7f341c066ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-424583178", "metadata": {"Type": "work"}}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 07:59:32.757924 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9d411785-ad16-4e3a-972f-ab3926711e2a tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:59:32.758731 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9d411785-ad16-4e3a-972f-ab3926711e2a tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005418 Aug 30 07:59:32.759223 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 779/1508] 10.222.0.73 () {60 vars in 1156 bytes} [Mon Aug 30 07:59:32 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 07:59:32.767014 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f9bb9967-c7b0-47bf-bdcd-c42346641842 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Calling method '.version_select at 0x7f341c1a4670>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:32.793961 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-f9bb9967-c7b0-47bf-bdcd-c42346641842 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] HTTP exception thrown: Volume tempest-invalid-816874774 could not be found. Aug 30 07:59:32.794575 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f9bb9967-c7b0-47bf-bdcd-c42346641842 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Returning 404 to user: Volume tempest-invalid-816874774 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:59:32.795405 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f9bb9967-c7b0-47bf-bdcd-c42346641842 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-816874774" status: 404 len: 98 microversion: 2.1 time: 0.031708 Aug 30 07:59:32.795934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 730/1509] 10.222.0.73 () {58 vars in 1215 bytes} [Mon Aug 30 07:59:32 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-816874774 => generated 98 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 07:59:32.805583 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-76e0c498-579b-4891-a54d-1d8782cb2091 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004277 Aug 30 07:59:32.806069 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 780/1510] 10.222.0.73 () {58 vars in 1140 bytes} [Mon Aug 30 07:59:32 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 07:59:32.815124 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b24c2b33-87ed-47a6-855b-01eec6e668de tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003481 Aug 30 07:59:32.815622 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 731/1511] 10.222.0.73 () {58 vars in 1137 bytes} [Mon Aug 30 07:59:32 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 07:59:32.823378 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cee15ddd-a896-4c37-b2ca-f60cad820ba7 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Calling method '.version_select at 0x7f341df5fe50>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:32.850882 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-cee15ddd-a896-4c37-b2ca-f60cad820ba7 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] HTTP exception thrown: Volume 7267cab6-674b-4ff1-be2f-0d88b8e96df8 could not be found. Aug 30 07:59:32.851482 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-cee15ddd-a896-4c37-b2ca-f60cad820ba7 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Returning 404 to user: Volume 7267cab6-674b-4ff1-be2f-0d88b8e96df8 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:59:32.852669 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-cee15ddd-a896-4c37-b2ca-f60cad820ba7 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/7267cab6-674b-4ff1-be2f-0d88b8e96df8" status: 404 len: 109 microversion: 2.1 time: 0.032677 Aug 30 07:59:32.853188 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 781/1512] 10.222.0.73 () {58 vars in 1248 bytes} [Mon Aug 30 07:59:32 2021] DELETE /compute/v2.1/os-volumes/7267cab6-674b-4ff1-be2f-0d88b8e96df8 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 07:59:32.864694 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c9c5d236-4e78-4d53-b955-6fbc435861e2 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Calling method '.version_select at 0x7f341c1a4550>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 07:59:32.890636 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-c9c5d236-4e78-4d53-b955-6fbc435861e2 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] HTTP exception thrown: Volume 6c63b654-5382-4fe8-bdb9-aa3bf62880f8 could not be found. Aug 30 07:59:32.891225 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c9c5d236-4e78-4d53-b955-6fbc435861e2 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] Returning 404 to user: Volume 6c63b654-5382-4fe8-bdb9-aa3bf62880f8 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 07:59:32.892054 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c9c5d236-4e78-4d53-b955-6fbc435861e2 tempest-VolumesNegativeTest-2113021798 tempest-VolumesNegativeTest-2113021798-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/6c63b654-5382-4fe8-bdb9-aa3bf62880f8" status: 404 len: 109 microversion: 2.1 time: 0.031849 Aug 30 07:59:32.892589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 732/1513] 10.222.0.73 () {58 vars in 1245 bytes} [Mon Aug 30 07:59:32 2021] GET /compute/v2.1/os-volumes/6c63b654-5382-4fe8-bdb9-aa3bf62880f8 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 08:00:18.742613 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7313c935-b52d-4cc7-a1ec-4114f3f3bb4d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Action: 'create', calling method: .version_select at 0x7f341c137ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-465833747"}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:00:18.762647 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-7313c935-b52d-4cc7-a1ec-4114f3f3bb4d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Getting quotas for project 8d8bc861de4e4b05b9e798f101735072. Resources: {'key_pairs'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 08:00:18.766629 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-7313c935-b52d-4cc7-a1ec-4114f3f3bb4d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Getting quotas for user 88b988bf652b4658acaa6d7b74d37f9b and project 8d8bc861de4e4b05b9e798f101735072. Resources: {'key_pairs'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 08:00:18.779060 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7313c935-b52d-4cc7-a1ec-4114f3f3bb4d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [d386f80c-0ec1-4bd9-a060-970aeb934bae] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 08:00:19.797475 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO oslo.messaging._drivers.impl_rabbit [None req-7313c935-b52d-4cc7-a1ec-4114f3f3bb4d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [d386f80c-0ec1-4bd9-a060-970aeb934bae] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 33480. Aug 30 08:00:19.986103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-7313c935-b52d-4cc7-a1ec-4114f3f3bb4d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Getting quotas for project 8d8bc861de4e4b05b9e798f101735072. Resources: {'key_pairs'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 08:00:19.990478 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-7313c935-b52d-4cc7-a1ec-4114f3f3bb4d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Getting quotas for user 88b988bf652b4658acaa6d7b74d37f9b and project 8d8bc861de4e4b05b9e798f101735072. Resources: {'key_pairs'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 08:00:20.004524 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7313c935-b52d-4cc7-a1ec-4114f3f3bb4d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 1.445968 Aug 30 08:00:20.010505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 782/1514] 10.222.0.73 () {60 vars in 1158 bytes} [Mon Aug 30 08:00:18 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:00:38.494800 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-18d016e9-32c1-46e0-9d16-0fb4b65e03ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:38.496576 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-18d016e9-32c1-46e0-9d16-0fb4b65e03ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:38.503084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18d016e9-32c1-46e0-9d16-0fb4b65e03ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:38.503534 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18d016e9-32c1-46e0-9d16-0fb4b65e03ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:38.504341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18d016e9-32c1-46e0-9d16-0fb4b65e03ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:38.504723 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-18d016e9-32c1-46e0-9d16-0fb4b65e03ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:38.532642 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-18d016e9-32c1-46e0-9d16-0fb4b65e03ce tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043566 Aug 30 08:00:38.533120 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 733/1515] 10.222.0.73 () {60 vars in 1343 bytes} [Mon Aug 30 08:00:38 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:00:38.592886 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-35417288-584c-4df9-9561-9203a3ace9bf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:38.593506 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-35417288-584c-4df9-9561-9203a3ace9bf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:38.600044 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35417288-584c-4df9-9561-9203a3ace9bf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:38.600494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35417288-584c-4df9-9561-9203a3ace9bf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:38.601250 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35417288-584c-4df9-9561-9203a3ace9bf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:38.601678 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-35417288-584c-4df9-9561-9203a3ace9bf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:38.625195 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-35417288-584c-4df9-9561-9203a3ace9bf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 08:00:38.697490 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-35417288-584c-4df9-9561-9203a3ace9bf tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "DELETE /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 204 len: 0 microversion: 2.20 time: 0.108889 Aug 30 08:00:38.698061 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 783/1516] 10.222.0.73 () {60 vars in 1280 bytes} [Mon Aug 30 08:00:38 2021] DELETE /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 08:00:38.706742 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-27fe6362-2a5f-4b94-9dc5-baa959e23e1a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:38.707444 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-27fe6362-2a5f-4b94-9dc5-baa959e23e1a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:38.713174 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27fe6362-2a5f-4b94-9dc5-baa959e23e1a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:38.713622 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27fe6362-2a5f-4b94-9dc5-baa959e23e1a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:38.715051 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27fe6362-2a5f-4b94-9dc5-baa959e23e1a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:38.715491 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27fe6362-2a5f-4b94-9dc5-baa959e23e1a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:38.837535 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-27fe6362-2a5f-4b94-9dc5-baa959e23e1a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:38.845922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-27fe6362-2a5f-4b94-9dc5-baa959e23e1a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:38.847452 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-27fe6362-2a5f-4b94-9dc5-baa959e23e1a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:38.848586 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-27fe6362-2a5f-4b94-9dc5-baa959e23e1a tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.145589 Aug 30 08:00:38.849133 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 734/1517] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 08:00:38 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 08:00:39.868613 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-95f08e7e-7c48-48c4-878a-248275f96d9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:39.869312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-95f08e7e-7c48-48c4-878a-248275f96d9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:39.875570 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95f08e7e-7c48-48c4-878a-248275f96d9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:39.876013 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95f08e7e-7c48-48c4-878a-248275f96d9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:39.876765 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95f08e7e-7c48-48c4-878a-248275f96d9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:39.877194 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-95f08e7e-7c48-48c4-878a-248275f96d9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:39.999205 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-95f08e7e-7c48-48c4-878a-248275f96d9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:40.006849 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-95f08e7e-7c48-48c4-878a-248275f96d9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:40.008341 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-95f08e7e-7c48-48c4-878a-248275f96d9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:40.009473 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-95f08e7e-7c48-48c4-878a-248275f96d9e tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.145219 Aug 30 08:00:40.010020 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 784/1518] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 08:00:39 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 08:00:41.028421 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6f596226-fea4-4798-9a11-17816174a3c0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:41.029059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6f596226-fea4-4798-9a11-17816174a3c0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:41.034839 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f596226-fea4-4798-9a11-17816174a3c0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:41.035286 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f596226-fea4-4798-9a11-17816174a3c0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:41.036048 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f596226-fea4-4798-9a11-17816174a3c0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:41.036512 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6f596226-fea4-4798-9a11-17816174a3c0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:41.233083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6f596226-fea4-4798-9a11-17816174a3c0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:41.242643 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6f596226-fea4-4798-9a11-17816174a3c0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:41.245031 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6f596226-fea4-4798-9a11-17816174a3c0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:41.245222 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6f596226-fea4-4798-9a11-17816174a3c0 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1724 microversion: 2.20 time: 0.221161 Aug 30 08:00:41.247075 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 735/1519] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 08:00:41 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 08:00:42.187845 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-f6c8b6dc-7dc5-4f47-a8ca-ae9d1137d50e req-b52caec2-c6a0-4683-99ce-5b9232e866f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bba115-ffa4-48f5-9f97-30c8117579c2", "name": "network-vif-deleted", "tag": "433de034-350e-4435-8de8-087595037325"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:00:42.190361 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:00:42.190361 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 08:00:42.201231 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-f6c8b6dc-7dc5-4f47-a8ca-ae9d1137d50e req-b52caec2-c6a0-4683-99ce-5b9232e866f0 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:42.201753 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-f6c8b6dc-7dc5-4f47-a8ca-ae9d1137d50e req-b52caec2-c6a0-4683-99ce-5b9232e866f0 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:42.216043 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-f6c8b6dc-7dc5-4f47-a8ca-ae9d1137d50e req-b52caec2-c6a0-4683-99ce-5b9232e866f0 service nova] Creating event network-vif-deleted:433de034-350e-4435-8de8-087595037325 for instance 04bba115-ffa4-48f5-9f97-30c8117579c2 on hv-cinder-80619 Aug 30 08:00:42.222384 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-f6c8b6dc-7dc5-4f47-a8ca-ae9d1137d50e req-b52caec2-c6a0-4683-99ce-5b9232e866f0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038530 Aug 30 08:00:42.223179 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 785/1520] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:00:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:00:42.264920 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:42.265474 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:42.271958 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:42.272492 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:42.273548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:42.274051 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:42.307113 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:42.307471 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:42.307930 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lazy-loading 'fault' on Instance uuid 04bba115-ffa4-48f5-9f97-30c8117579c2 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 08:00:42.347418 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:42.355221 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:42.356989 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd0b9269e5fb4c6fa880c5217149b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a024ebf24f430393b00d5d8777b746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:42.358106 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c0631cdf-cdad-4ad8-9258-bd2bb74e9ae3 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 200 len: 1372 microversion: 2.20 time: 0.097877 Aug 30 08:00:42.358728 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 736/1521] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 08:00:42 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 08:00:43.376612 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e08bff09-c4d6-4b25-a21e-1772163c5d67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:43.377334 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e08bff09-c4d6-4b25-a21e-1772163c5d67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:43.383335 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e08bff09-c4d6-4b25-a21e-1772163c5d67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:43.383781 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e08bff09-c4d6-4b25-a21e-1772163c5d67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:43.384563 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e08bff09-c4d6-4b25-a21e-1772163c5d67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:43.384993 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e08bff09-c4d6-4b25-a21e-1772163c5d67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:43.397856 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-e08bff09-c4d6-4b25-a21e-1772163c5d67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] HTTP exception thrown: Instance 04bba115-ffa4-48f5-9f97-30c8117579c2 could not be found. Aug 30 08:00:43.398450 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e08bff09-c4d6-4b25-a21e-1772163c5d67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Returning 404 to user: Instance 04bba115-ffa4-48f5-9f97-30c8117579c2 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 08:00:43.399286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e08bff09-c4d6-4b25-a21e-1772163c5d67 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 404 len: 111 microversion: 2.20 time: 0.026746 Aug 30 08:00:43.399790 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 786/1522] 10.222.0.73 () {60 vars in 1277 bytes} [Mon Aug 30 08:00:43 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 08:00:43.408752 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a27a4e97-8651-4696-aa16-b978ae00656b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '.version_select at 0x7f341c1345e0>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:43.427689 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a27a4e97-8651-4696-aa16-b978ae00656b tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224250265" status: 204 len: 0 microversion: 2.20 time: 0.022572 Aug 30 08:00:43.428231 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 737/1523] 10.222.0.73 () {60 vars in 1262 bytes} [Mon Aug 30 08:00:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224250265 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 08:00:45.225494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6ac62715-2b23-42d0-af80-f45580b54b66 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:45.225995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6ac62715-2b23-42d0-af80-f45580b54b66 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:45.232518 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ac62715-2b23-42d0-af80-f45580b54b66 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:45.232963 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ac62715-2b23-42d0-af80-f45580b54b66 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:45.233728 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ac62715-2b23-42d0-af80-f45580b54b66 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:45.234191 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6ac62715-2b23-42d0-af80-f45580b54b66 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:45.247213 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-6ac62715-2b23-42d0-af80-f45580b54b66 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] HTTP exception thrown: Instance 04bba115-ffa4-48f5-9f97-30c8117579c2 could not be found. Aug 30 08:00:45.247795 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6ac62715-2b23-42d0-af80-f45580b54b66 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Returning 404 to user: Instance 04bba115-ffa4-48f5-9f97-30c8117579c2 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 08:00:45.248608 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6ac62715-2b23-42d0-af80-f45580b54b66 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "DELETE /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 404 len: 111 microversion: 2.1 time: 0.026904 Aug 30 08:00:45.249112 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 787/1524] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 08:00:45 2021] DELETE /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 08:00:45.256992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-46e68551-d951-48ed-9627-8e1a1fcf5c41 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:45.257605 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-46e68551-d951-48ed-9627-8e1a1fcf5c41 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 04bba115-ffa4-48f5-9f97-30c8117579c2] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:45.264163 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46e68551-d951-48ed-9627-8e1a1fcf5c41 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:45.264609 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46e68551-d951-48ed-9627-8e1a1fcf5c41 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:45.265363 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46e68551-d951-48ed-9627-8e1a1fcf5c41 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:45.265794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-46e68551-d951-48ed-9627-8e1a1fcf5c41 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:45.279511 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-46e68551-d951-48ed-9627-8e1a1fcf5c41 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] HTTP exception thrown: Instance 04bba115-ffa4-48f5-9f97-30c8117579c2 could not be found. Aug 30 08:00:45.280084 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-46e68551-d951-48ed-9627-8e1a1fcf5c41 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Returning 404 to user: Instance 04bba115-ffa4-48f5-9f97-30c8117579c2 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 08:00:45.280891 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-46e68551-d951-48ed-9627-8e1a1fcf5c41 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2" status: 404 len: 111 microversion: 2.1 time: 0.028016 Aug 30 08:00:45.281401 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 738/1525] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:45 2021] GET /compute/v2.1/servers/04bba115-ffa4-48f5-9f97-30c8117579c2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 08:00:46.408005 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-69b09ea6-520e-43c7-b619-fbcbad4670e1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:46.408620 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-69b09ea6-520e-43c7-b619-fbcbad4670e1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:46.414363 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-69b09ea6-520e-43c7-b619-fbcbad4670e1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:46.414814 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-69b09ea6-520e-43c7-b619-fbcbad4670e1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:46.415566 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-69b09ea6-520e-43c7-b619-fbcbad4670e1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:46.415992 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-69b09ea6-520e-43c7-b619-fbcbad4670e1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:46.429620 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-69b09ea6-520e-43c7-b619-fbcbad4670e1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] HTTP exception thrown: Instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f could not be found. Aug 30 08:00:46.430221 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-69b09ea6-520e-43c7-b619-fbcbad4670e1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Returning 404 to user: Instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 08:00:46.431033 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-69b09ea6-520e-43c7-b619-fbcbad4670e1 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 404 len: 111 microversion: 2.1 time: 0.026742 Aug 30 08:00:46.431534 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 788/1526] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 08:00:46 2021] DELETE /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 08:00:46.439309 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-acc9eacd-22e4-4681-bc26-15cb32370b12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:46.439933 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-acc9eacd-22e4-4681-bc26-15cb32370b12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] [instance: 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:46.445639 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-acc9eacd-22e4-4681-bc26-15cb32370b12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:46.446079 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-acc9eacd-22e4-4681-bc26-15cb32370b12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:46.446903 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-acc9eacd-22e4-4681-bc26-15cb32370b12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:46.447382 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-acc9eacd-22e4-4681-bc26-15cb32370b12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:46.461282 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-acc9eacd-22e4-4681-bc26-15cb32370b12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] HTTP exception thrown: Instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f could not be found. Aug 30 08:00:46.461853 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-acc9eacd-22e4-4681-bc26-15cb32370b12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] Returning 404 to user: Instance 8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 08:00:46.462702 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-acc9eacd-22e4-4681-bc26-15cb32370b12 tempest-AttachVolumeShelveTestJSON-1284222487 tempest-AttachVolumeShelveTestJSON-1284222487-project] 10.222.0.73 "GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f" status: 404 len: 111 microversion: 2.1 time: 0.027096 Aug 30 08:00:46.463214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 739/1527] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:46 2021] GET /compute/v2.1/servers/8c2efe3b-32a3-4f00-9d43-05d8ca4ef84f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 08:00:48.092532 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-876648612", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-465833747", "security_groups": [{"name": "tempest-secgroup-smoke-2102052867"}], "block_device_mapping_v2": [{"uuid": "05bb33ed-3224-498f-a974-1d3c0e5cfe58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f9bdf19d-4247-4c5d-a0b9-ca04cf41736f"}]}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:00:48.221026 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.network.neutron [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] validate_networks() for [('f9bdf19d-4247-4c5d-a0b9-ca04cf41736f', None, None, None, None, None)] {{(pid=114671) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 08:00:48.930777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Flavor limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 08:00:48.931230 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Image limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 08:00:48.931736 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Flavor pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 08:00:48.932195 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Image pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 08:00:48.932607 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 08:00:48.942230 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:48.942722 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:48.943580 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:48.944022 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:48.961182 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Getting quotas for project 8d8bc861de4e4b05b9e798f101735072. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 08:00:48.965234 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Getting quotas for user 88b988bf652b4658acaa6d7b74d37f9b and project 8d8bc861de4e4b05b9e798f101735072. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 08:00:49.031822 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Going to run 1 instances... {{(pid=114671) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 08:00:49.033936 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='05bb33ed-3224-498f-a974-1d3c0e5cfe58',volume_size=None,volume_type=None)] {{(pid=114671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 08:00:49.169239 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-237d7a15-43fc-4a27-8bea-abd8ad6475c4 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.079988 Aug 30 08:00:49.174305 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 789/1528] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 08:00:48 2021] POST /compute/v2.1/servers => generated 406 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 08:00:49.180437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-7b5871c8-0a76-445f-a496-5d620a2bb214 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:49.181743 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-7b5871c8-0a76-445f-a496-5d620a2bb214 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:49.245191 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-7b5871c8-0a76-445f-a496-5d620a2bb214 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:49.252900 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-7b5871c8-0a76-445f-a496-5d620a2bb214 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1093 microversion: 2.1 time: 0.076066 Aug 30 08:00:49.253415 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 740/1529] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:49 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:00:50.269703 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1d96f243-ac08-48a0-ab88-1ff42749c36b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:50.270420 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1d96f243-ac08-48a0-ab88-1ff42749c36b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:50.277293 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d96f243-ac08-48a0-ab88-1ff42749c36b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:50.278259 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d96f243-ac08-48a0-ab88-1ff42749c36b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:50.279151 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d96f243-ac08-48a0-ab88-1ff42749c36b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:50.279587 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d96f243-ac08-48a0-ab88-1ff42749c36b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:50.349340 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1d96f243-ac08-48a0-ab88-1ff42749c36b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:50.361004 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1d96f243-ac08-48a0-ab88-1ff42749c36b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1209 microversion: 2.1 time: 0.095488 Aug 30 08:00:50.370888 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 790/1530] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:50 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:00:51.378603 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8cec6b2e-622c-48d8-9bd6-4854f872e2cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:51.379482 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8cec6b2e-622c-48d8-9bd6-4854f872e2cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:51.385593 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8cec6b2e-622c-48d8-9bd6-4854f872e2cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:51.386049 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8cec6b2e-622c-48d8-9bd6-4854f872e2cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:51.386864 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8cec6b2e-622c-48d8-9bd6-4854f872e2cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:51.387837 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8cec6b2e-622c-48d8-9bd6-4854f872e2cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:51.712502 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8cec6b2e-622c-48d8-9bd6-4854f872e2cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:51.722142 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8cec6b2e-622c-48d8-9bd6-4854f872e2cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.346834 Aug 30 08:00:51.732724 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 741/1531] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:51 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:00:51.848379 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-b10d2b8c-81f9-48a3-ab31-f440ebd7c4f7 req-b9b159df-47bb-4590-8498-5f883f9fa601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4547bc1-f924-47d7-b393-dc33089c1398", "tag": "c02f326b-8b5a-4810-9334-a2d508d1d10e"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:00:51.849954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:00:51.849954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 08:00:51.864403 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-b10d2b8c-81f9-48a3-ab31-f440ebd7c4f7 req-b9b159df-47bb-4590-8498-5f883f9fa601 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:51.865044 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-b10d2b8c-81f9-48a3-ab31-f440ebd7c4f7 req-b9b159df-47bb-4590-8498-5f883f9fa601 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:51.877831 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-b10d2b8c-81f9-48a3-ab31-f440ebd7c4f7 req-b9b159df-47bb-4590-8498-5f883f9fa601 service nova] Creating event network-changed:c02f326b-8b5a-4810-9334-a2d508d1d10e for instance d4547bc1-f924-47d7-b393-dc33089c1398 on hv-cinder-80619 Aug 30 08:00:51.883062 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-b10d2b8c-81f9-48a3-ab31-f440ebd7c4f7 req-b9b159df-47bb-4590-8498-5f883f9fa601 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038150 Aug 30 08:00:51.884589 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 791/1532] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:00:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:00:52.740772 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3542c129-a589-4370-8106-e7734681e2c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:52.741529 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3542c129-a589-4370-8106-e7734681e2c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:52.748545 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3542c129-a589-4370-8106-e7734681e2c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:52.749062 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3542c129-a589-4370-8106-e7734681e2c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:52.749910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3542c129-a589-4370-8106-e7734681e2c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:52.750437 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3542c129-a589-4370-8106-e7734681e2c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:52.902513 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3542c129-a589-4370-8106-e7734681e2c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:52.910471 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3542c129-a589-4370-8106-e7734681e2c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.173685 Aug 30 08:00:52.911043 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 742/1533] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:52 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:00:53.927093 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-0e02b65f-4732-4319-8b1a-62fac112e60b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:53.927794 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-0e02b65f-4732-4319-8b1a-62fac112e60b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:53.933581 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0e02b65f-4732-4319-8b1a-62fac112e60b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:53.934026 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0e02b65f-4732-4319-8b1a-62fac112e60b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:53.934916 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0e02b65f-4732-4319-8b1a-62fac112e60b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:53.935529 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-0e02b65f-4732-4319-8b1a-62fac112e60b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:54.055869 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-0e02b65f-4732-4319-8b1a-62fac112e60b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:54.063725 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-0e02b65f-4732-4319-8b1a-62fac112e60b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.140626 Aug 30 08:00:54.064296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 792/1534] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:53 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:00:55.080623 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-dd718ef3-9202-4c22-8fde-8607a7b7513c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:55.081164 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-dd718ef3-9202-4c22-8fde-8607a7b7513c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:55.087474 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd718ef3-9202-4c22-8fde-8607a7b7513c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:55.088045 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd718ef3-9202-4c22-8fde-8607a7b7513c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:55.088968 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd718ef3-9202-4c22-8fde-8607a7b7513c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:55.089690 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-dd718ef3-9202-4c22-8fde-8607a7b7513c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:55.213161 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-dd718ef3-9202-4c22-8fde-8607a7b7513c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:55.220539 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-dd718ef3-9202-4c22-8fde-8607a7b7513c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.143756 Aug 30 08:00:55.221103 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 743/1535] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:55 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:00:56.237062 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-336e01f0-fef9-42c9-893a-383ec51fcf27 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:56.238428 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-336e01f0-fef9-42c9-893a-383ec51fcf27 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:56.244427 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-336e01f0-fef9-42c9-893a-383ec51fcf27 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:56.244884 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-336e01f0-fef9-42c9-893a-383ec51fcf27 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:56.245640 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-336e01f0-fef9-42c9-893a-383ec51fcf27 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:56.246074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-336e01f0-fef9-42c9-893a-383ec51fcf27 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:56.368901 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-336e01f0-fef9-42c9-893a-383ec51fcf27 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:56.376788 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-336e01f0-fef9-42c9-893a-383ec51fcf27 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.143763 Aug 30 08:00:56.377352 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 793/1536] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:56 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:00:57.393180 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5287736e-56c3-4699-9447-6d5a2addfcf6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:57.393791 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5287736e-56c3-4699-9447-6d5a2addfcf6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:57.399724 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5287736e-56c3-4699-9447-6d5a2addfcf6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:57.400166 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5287736e-56c3-4699-9447-6d5a2addfcf6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:57.400919 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5287736e-56c3-4699-9447-6d5a2addfcf6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:57.401347 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5287736e-56c3-4699-9447-6d5a2addfcf6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:57.519881 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5287736e-56c3-4699-9447-6d5a2addfcf6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:57.527059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5287736e-56c3-4699-9447-6d5a2addfcf6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.137540 Aug 30 08:00:57.527618 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 744/1537] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:57 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:00:58.543605 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1d64b8d4-d646-4e9b-b7f6-ebcb07f22d24 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:58.545168 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1d64b8d4-d646-4e9b-b7f6-ebcb07f22d24 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:58.551108 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d64b8d4-d646-4e9b-b7f6-ebcb07f22d24 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:58.551554 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d64b8d4-d646-4e9b-b7f6-ebcb07f22d24 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:58.552318 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d64b8d4-d646-4e9b-b7f6-ebcb07f22d24 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:58.552755 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1d64b8d4-d646-4e9b-b7f6-ebcb07f22d24 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:58.675739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1d64b8d4-d646-4e9b-b7f6-ebcb07f22d24 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:58.683028 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1d64b8d4-d646-4e9b-b7f6-ebcb07f22d24 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.143110 Aug 30 08:00:58.683600 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 794/1538] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:58 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:00:59.699564 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e3b8ef1d-a851-4fe6-9865-ce41c007d7c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:00:59.700111 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e3b8ef1d-a851-4fe6-9865-ce41c007d7c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:00:59.706087 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3b8ef1d-a851-4fe6-9865-ce41c007d7c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:59.706557 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3b8ef1d-a851-4fe6-9865-ce41c007d7c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:59.707307 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3b8ef1d-a851-4fe6-9865-ce41c007d7c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:00:59.707739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e3b8ef1d-a851-4fe6-9865-ce41c007d7c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:00:59.828281 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e3b8ef1d-a851-4fe6-9865-ce41c007d7c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:00:59.835377 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e3b8ef1d-a851-4fe6-9865-ce41c007d7c2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.139623 Aug 30 08:00:59.835963 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 745/1539] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:00:59 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:01:00.852087 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2c2f265a-ef3e-426c-96ff-3a1db52d14d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:01:00.852708 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2c2f265a-ef3e-426c-96ff-3a1db52d14d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:01:00.859680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2c2f265a-ef3e-426c-96ff-3a1db52d14d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:00.860132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2c2f265a-ef3e-426c-96ff-3a1db52d14d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:00.860900 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2c2f265a-ef3e-426c-96ff-3a1db52d14d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:00.861335 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2c2f265a-ef3e-426c-96ff-3a1db52d14d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:00.988232 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2c2f265a-ef3e-426c-96ff-3a1db52d14d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:01:00.999821 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2c2f265a-ef3e-426c-96ff-3a1db52d14d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.151439 Aug 30 08:01:01.000398 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 795/1540] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:01:00 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:01:02.018945 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-e2841c9a-2274-462f-8618-57d8f0ada9c3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:01:02.019729 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-e2841c9a-2274-462f-8618-57d8f0ada9c3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:01:02.026301 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e2841c9a-2274-462f-8618-57d8f0ada9c3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:02.026756 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e2841c9a-2274-462f-8618-57d8f0ada9c3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:02.027538 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e2841c9a-2274-462f-8618-57d8f0ada9c3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:02.027977 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-e2841c9a-2274-462f-8618-57d8f0ada9c3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:02.153316 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-e2841c9a-2274-462f-8618-57d8f0ada9c3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:01:02.161345 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-e2841c9a-2274-462f-8618-57d8f0ada9c3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.146679 Aug 30 08:01:02.161982 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 746/1541] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:01:02 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 08:01:03.178569 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-dbd02595-23c9-4119-b9dd-904ee98e738e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:01:03.179178 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-dbd02595-23c9-4119-b9dd-904ee98e738e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:01:03.184893 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbd02595-23c9-4119-b9dd-904ee98e738e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:03.185904 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbd02595-23c9-4119-b9dd-904ee98e738e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:03.186680 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbd02595-23c9-4119-b9dd-904ee98e738e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:03.187115 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-dbd02595-23c9-4119-b9dd-904ee98e738e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:03.308875 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-dbd02595-23c9-4119-b9dd-904ee98e738e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:01:03.316095 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-dbd02595-23c9-4119-b9dd-904ee98e738e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.141118 Aug 30 08:01:03.316651 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 796/1542] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:01:03 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:01:04.048983 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-aa5d78d8-8aa5-4d03-96e1-e434c538a3d6 req-b51a0e4a-a2a0-417d-89cb-0c8b21a58be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4547bc1-f924-47d7-b393-dc33089c1398", "name": "network-vif-plugged", "status": "completed", "tag": "c02f326b-8b5a-4810-9334-a2d508d1d10e"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:01:04.050669 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:01:04.050669 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 08:01:04.057825 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-aa5d78d8-8aa5-4d03-96e1-e434c538a3d6 req-b51a0e4a-a2a0-417d-89cb-0c8b21a58be8 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:04.058278 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-aa5d78d8-8aa5-4d03-96e1-e434c538a3d6 req-b51a0e4a-a2a0-417d-89cb-0c8b21a58be8 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:04.069889 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-aa5d78d8-8aa5-4d03-96e1-e434c538a3d6 req-b51a0e4a-a2a0-417d-89cb-0c8b21a58be8 service nova] Creating event network-vif-plugged:c02f326b-8b5a-4810-9334-a2d508d1d10e for instance d4547bc1-f924-47d7-b393-dc33089c1398 on hv-cinder-80619 Aug 30 08:01:04.077100 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-aa5d78d8-8aa5-4d03-96e1-e434c538a3d6 req-b51a0e4a-a2a0-417d-89cb-0c8b21a58be8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031748 Aug 30 08:01:04.077873 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 747/1543] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:01:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 08:01:04.332689 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b147c132-d33b-4fa5-bff3-0ab89f6483d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:01:04.333637 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b147c132-d33b-4fa5-bff3-0ab89f6483d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:01:04.341144 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b147c132-d33b-4fa5-bff3-0ab89f6483d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:04.342172 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b147c132-d33b-4fa5-bff3-0ab89f6483d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:04.343150 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b147c132-d33b-4fa5-bff3-0ab89f6483d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:04.343577 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b147c132-d33b-4fa5-bff3-0ab89f6483d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:04.490715 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b147c132-d33b-4fa5-bff3-0ab89f6483d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:01:04.498961 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b147c132-d33b-4fa5-bff3-0ab89f6483d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.170063 Aug 30 08:01:04.499622 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 797/1544] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:01:04 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:01:05.515878 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bf2cb66e-1daf-4247-9f20-af3f861165bc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:01:05.516579 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bf2cb66e-1daf-4247-9f20-af3f861165bc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:01:05.522447 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf2cb66e-1daf-4247-9f20-af3f861165bc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:05.522890 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf2cb66e-1daf-4247-9f20-af3f861165bc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:05.523651 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf2cb66e-1daf-4247-9f20-af3f861165bc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:05.524078 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bf2cb66e-1daf-4247-9f20-af3f861165bc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:05.656762 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-bf2cb66e-1daf-4247-9f20-af3f861165bc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:01:05.663897 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bf2cb66e-1daf-4247-9f20-af3f861165bc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1265 microversion: 2.1 time: 0.152220 Aug 30 08:01:05.664446 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 748/1545] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:01:05 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:01:06.680426 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a1e8e109-faf9-4bc9-9b99-b9c03555b6f3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:01:06.681046 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a1e8e109-faf9-4bc9-9b99-b9c03555b6f3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:01:06.687521 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a1e8e109-faf9-4bc9-9b99-b9c03555b6f3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:06.687972 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a1e8e109-faf9-4bc9-9b99-b9c03555b6f3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:06.688741 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a1e8e109-faf9-4bc9-9b99-b9c03555b6f3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:06.689177 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a1e8e109-faf9-4bc9-9b99-b9c03555b6f3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:06.812846 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a1e8e109-faf9-4bc9-9b99-b9c03555b6f3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:01:06.821298 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a1e8e109-faf9-4bc9-9b99-b9c03555b6f3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1453 microversion: 2.1 time: 0.144510 Aug 30 08:01:06.822001 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 798/1546] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:01:06 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:01:06.836947 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0dddd49c-0828-4bd6-be01-7b7194ea0baa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:01:06.837592 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0dddd49c-0828-4bd6-be01-7b7194ea0baa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:01:06.843465 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0dddd49c-0828-4bd6-be01-7b7194ea0baa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:06.843916 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0dddd49c-0828-4bd6-be01-7b7194ea0baa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:06.844685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0dddd49c-0828-4bd6-be01-7b7194ea0baa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:06.845121 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0dddd49c-0828-4bd6-be01-7b7194ea0baa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:06.971555 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0dddd49c-0828-4bd6-be01-7b7194ea0baa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:01:06.978853 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0dddd49c-0828-4bd6-be01-7b7194ea0baa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1453 microversion: 2.1 time: 0.145579 Aug 30 08:01:06.979425 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 749/1547] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:01:06 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:01:09.014770 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-7b27748b-a910-487e-ab62-23b00183cd55 req-d3f69867-16c9-4acd-aec6-4cb2e93c3fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4547bc1-f924-47d7-b393-dc33089c1398", "tag": "c02f326b-8b5a-4810-9334-a2d508d1d10e"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:01:09.016324 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:01:09.016324 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 08:01:09.023350 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-7b27748b-a910-487e-ab62-23b00183cd55 req-d3f69867-16c9-4acd-aec6-4cb2e93c3fbd service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:09.023791 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-7b27748b-a910-487e-ab62-23b00183cd55 req-d3f69867-16c9-4acd-aec6-4cb2e93c3fbd service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:09.034826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-7b27748b-a910-487e-ab62-23b00183cd55 req-d3f69867-16c9-4acd-aec6-4cb2e93c3fbd service nova] Creating event network-changed:c02f326b-8b5a-4810-9334-a2d508d1d10e for instance d4547bc1-f924-47d7-b393-dc33089c1398 on hv-cinder-80619 Aug 30 08:01:09.039939 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-7b27748b-a910-487e-ab62-23b00183cd55 req-d3f69867-16c9-4acd-aec6-4cb2e93c3fbd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030270 Aug 30 08:01:09.040534 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 799/1548] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:01:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:01:13.868528 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 08:01:13.869341 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: Mon Aug 30 08:01:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 08:01:58.791940 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c63cab42-6d63-44dd-8bdd-f599f39f681b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:01:58.792673 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c63cab42-6d63-44dd-8bdd-f599f39f681b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:01:58.798546 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c63cab42-6d63-44dd-8bdd-f599f39f681b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:58.798989 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c63cab42-6d63-44dd-8bdd-f599f39f681b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:58.799770 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c63cab42-6d63-44dd-8bdd-f599f39f681b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:58.800287 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c63cab42-6d63-44dd-8bdd-f599f39f681b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:58.823218 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.objects.instance [None req-c63cab42-6d63-44dd-8bdd-f599f39f681b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lazy-loading 'flavor' on Instance uuid 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 {{(pid=114670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 30 08:01:58.891869 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c63cab42-6d63-44dd-8bdd-f599f39f681b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "POST /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9/action" status: 202 len: 0 microversion: 2.1 time: 0.103415 Aug 30 08:01:58.892548 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 750/1549] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 08:01:58 2021] POST /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 08:01:58.901693 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-21cf13b1-c1c1-420c-b659-a95c81ee19f7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:01:58.902436 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-21cf13b1-c1c1-420c-b659-a95c81ee19f7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:01:58.908794 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21cf13b1-c1c1-420c-b659-a95c81ee19f7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:58.909329 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21cf13b1-c1c1-420c-b659-a95c81ee19f7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:58.910103 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21cf13b1-c1c1-420c-b659-a95c81ee19f7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:01:58.910566 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-21cf13b1-c1c1-420c-b659-a95c81ee19f7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:01:59.030511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-21cf13b1-c1c1-420c-b659-a95c81ee19f7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:01:59.037904 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-21cf13b1-c1c1-420c-b659-a95c81ee19f7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.140363 Aug 30 08:01:59.038495 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 800/1550] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:01:58 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:00.055069 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-cfa6d728-ef70-4f06-bcd6-1adc016ad8df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:00.055921 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-cfa6d728-ef70-4f06-bcd6-1adc016ad8df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:00.061965 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cfa6d728-ef70-4f06-bcd6-1adc016ad8df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:00.062452 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cfa6d728-ef70-4f06-bcd6-1adc016ad8df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:00.063215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cfa6d728-ef70-4f06-bcd6-1adc016ad8df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:00.063647 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-cfa6d728-ef70-4f06-bcd6-1adc016ad8df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:00.185574 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-cfa6d728-ef70-4f06-bcd6-1adc016ad8df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:00.192902 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-cfa6d728-ef70-4f06-bcd6-1adc016ad8df tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.141931 Aug 30 08:02:00.193470 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 751/1551] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:00 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 08:02:01.209618 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b0e52d13-2755-4eba-9d3f-ec5b21b6f586 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:01.210252 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b0e52d13-2755-4eba-9d3f-ec5b21b6f586 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:01.216114 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0e52d13-2755-4eba-9d3f-ec5b21b6f586 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:01.216503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0e52d13-2755-4eba-9d3f-ec5b21b6f586 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:01.217253 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0e52d13-2755-4eba-9d3f-ec5b21b6f586 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:01.217681 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b0e52d13-2755-4eba-9d3f-ec5b21b6f586 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:01.333695 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b0e52d13-2755-4eba-9d3f-ec5b21b6f586 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:01.341876 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b0e52d13-2755-4eba-9d3f-ec5b21b6f586 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.135933 Aug 30 08:02:01.342466 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 801/1552] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:01 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:02.358941 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f5fc9d8b-a699-4bfd-b848-fcd59ab91ad3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:02.359556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f5fc9d8b-a699-4bfd-b848-fcd59ab91ad3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:02.366006 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5fc9d8b-a699-4bfd-b848-fcd59ab91ad3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:02.366472 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5fc9d8b-a699-4bfd-b848-fcd59ab91ad3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:02.367223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5fc9d8b-a699-4bfd-b848-fcd59ab91ad3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:02.367653 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5fc9d8b-a699-4bfd-b848-fcd59ab91ad3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:02.485277 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f5fc9d8b-a699-4bfd-b848-fcd59ab91ad3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:02.493817 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f5fc9d8b-a699-4bfd-b848-fcd59ab91ad3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.138716 Aug 30 08:02:02.494413 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 752/1553] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:02 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:03.511942 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-6d274ab6-74ef-40c4-a39d-f143a258a0ad tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:03.512550 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-6d274ab6-74ef-40c4-a39d-f143a258a0ad tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:03.519080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d274ab6-74ef-40c4-a39d-f143a258a0ad tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:03.519523 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d274ab6-74ef-40c4-a39d-f143a258a0ad tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:03.520271 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d274ab6-74ef-40c4-a39d-f143a258a0ad tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:03.520699 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-6d274ab6-74ef-40c4-a39d-f143a258a0ad tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:03.643227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-6d274ab6-74ef-40c4-a39d-f143a258a0ad tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:03.651505 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-6d274ab6-74ef-40c4-a39d-f143a258a0ad tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.143213 Aug 30 08:02:03.652074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 802/1554] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:03 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:04.668588 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-45ad8734-a061-44c8-b042-88d6988a5d36 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:04.669208 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-45ad8734-a061-44c8-b042-88d6988a5d36 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:04.675083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-45ad8734-a061-44c8-b042-88d6988a5d36 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:04.675533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-45ad8734-a061-44c8-b042-88d6988a5d36 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:04.676285 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-45ad8734-a061-44c8-b042-88d6988a5d36 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:04.676721 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-45ad8734-a061-44c8-b042-88d6988a5d36 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:04.796006 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-45ad8734-a061-44c8-b042-88d6988a5d36 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:04.803189 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-45ad8734-a061-44c8-b042-88d6988a5d36 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.138280 Aug 30 08:02:04.803751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 753/1555] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:04 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:05.819794 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4cb87beb-ac88-4e57-ad9b-a263c5f5e252 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:05.820411 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4cb87beb-ac88-4e57-ad9b-a263c5f5e252 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:05.826295 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4cb87beb-ac88-4e57-ad9b-a263c5f5e252 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:05.826742 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4cb87beb-ac88-4e57-ad9b-a263c5f5e252 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:05.827503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4cb87beb-ac88-4e57-ad9b-a263c5f5e252 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:05.827970 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4cb87beb-ac88-4e57-ad9b-a263c5f5e252 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:05.947524 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4cb87beb-ac88-4e57-ad9b-a263c5f5e252 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:05.954777 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4cb87beb-ac88-4e57-ad9b-a263c5f5e252 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.138656 Aug 30 08:02:05.955329 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 803/1556] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:05 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:06.971452 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-6995502a-fa85-42de-8146-a3ce55db4a39 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:06.972069 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-6995502a-fa85-42de-8146-a3ce55db4a39 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:06.977961 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6995502a-fa85-42de-8146-a3ce55db4a39 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:06.978428 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6995502a-fa85-42de-8146-a3ce55db4a39 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:06.979181 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6995502a-fa85-42de-8146-a3ce55db4a39 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:06.979610 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-6995502a-fa85-42de-8146-a3ce55db4a39 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:07.100642 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-6995502a-fa85-42de-8146-a3ce55db4a39 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:07.107903 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-6995502a-fa85-42de-8146-a3ce55db4a39 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.140080 Aug 30 08:02:07.108465 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 754/1557] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:06 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:08.125010 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1ec6f41a-8b27-4b84-8176-78401056b1b3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:08.125682 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1ec6f41a-8b27-4b84-8176-78401056b1b3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:08.132511 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1ec6f41a-8b27-4b84-8176-78401056b1b3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:08.132958 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1ec6f41a-8b27-4b84-8176-78401056b1b3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:08.133728 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1ec6f41a-8b27-4b84-8176-78401056b1b3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:08.134175 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1ec6f41a-8b27-4b84-8176-78401056b1b3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:08.251844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1ec6f41a-8b27-4b84-8176-78401056b1b3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:08.259584 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1ec6f41a-8b27-4b84-8176-78401056b1b3 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.138516 Aug 30 08:02:08.260152 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 804/1558] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:08 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:09.276528 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-be17229b-2160-48d4-b207-fe491f5209c0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:09.277179 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-be17229b-2160-48d4-b207-fe491f5209c0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:09.283021 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-be17229b-2160-48d4-b207-fe491f5209c0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:09.283467 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-be17229b-2160-48d4-b207-fe491f5209c0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:09.284227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-be17229b-2160-48d4-b207-fe491f5209c0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:09.284687 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-be17229b-2160-48d4-b207-fe491f5209c0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:09.465557 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-be17229b-2160-48d4-b207-fe491f5209c0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:09.473404 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-be17229b-2160-48d4-b207-fe491f5209c0 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.200556 Aug 30 08:02:09.473972 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 755/1559] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:09 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:10.490743 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1287d118-d98e-42c3-beab-66fb2ce8374f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:10.491359 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1287d118-d98e-42c3-beab-66fb2ce8374f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:10.497128 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1287d118-d98e-42c3-beab-66fb2ce8374f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:10.497576 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1287d118-d98e-42c3-beab-66fb2ce8374f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:10.498614 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1287d118-d98e-42c3-beab-66fb2ce8374f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:10.499045 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1287d118-d98e-42c3-beab-66fb2ce8374f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:10.621812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1287d118-d98e-42c3-beab-66fb2ce8374f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:10.629873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1287d118-d98e-42c3-beab-66fb2ce8374f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.142945 Aug 30 08:02:10.630460 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 805/1560] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:10 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:11.647276 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-def19eba-0dea-414b-b071-94b609a764d9 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:11.647899 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-def19eba-0dea-414b-b071-94b609a764d9 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:11.653730 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-def19eba-0dea-414b-b071-94b609a764d9 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:11.654404 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-def19eba-0dea-414b-b071-94b609a764d9 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:11.655175 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-def19eba-0dea-414b-b071-94b609a764d9 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:11.655611 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-def19eba-0dea-414b-b071-94b609a764d9 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:11.780097 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-def19eba-0dea-414b-b071-94b609a764d9 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:11.787711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-def19eba-0dea-414b-b071-94b609a764d9 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.144706 Aug 30 08:02:11.788284 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 756/1561] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:11 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:12.804543 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-80d034aa-c78f-40e9-bf9a-0dc0e5215d3c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:12.805151 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-80d034aa-c78f-40e9-bf9a-0dc0e5215d3c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:12.810960 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80d034aa-c78f-40e9-bf9a-0dc0e5215d3c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:12.811401 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80d034aa-c78f-40e9-bf9a-0dc0e5215d3c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:12.812146 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80d034aa-c78f-40e9-bf9a-0dc0e5215d3c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:12.812571 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-80d034aa-c78f-40e9-bf9a-0dc0e5215d3c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:12.928723 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-80d034aa-c78f-40e9-bf9a-0dc0e5215d3c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:12.935895 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-80d034aa-c78f-40e9-bf9a-0dc0e5215d3c tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1507 microversion: 2.1 time: 0.135204 Aug 30 08:02:12.936447 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 806/1562] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:12 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1507 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:12.952267 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-425a13c3-314d-4693-9680-1dda3b67b43e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:02:12.952837 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-425a13c3-314d-4693-9680-1dda3b67b43e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:12.959188 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-425a13c3-314d-4693-9680-1dda3b67b43e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:12.959632 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-425a13c3-314d-4693-9680-1dda3b67b43e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:12.960393 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-425a13c3-314d-4693-9680-1dda3b67b43e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:12.960829 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-425a13c3-314d-4693-9680-1dda3b67b43e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:13.042279 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-425a13c3-314d-4693-9680-1dda3b67b43e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "POST /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9/action" status: 202 len: 0 microversion: 2.1 time: 0.093540 Aug 30 08:02:13.042804 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 757/1563] 10.222.0.73 () {60 vars in 1278 bytes} [Mon Aug 30 08:02:12 2021] POST /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 08:02:13.050817 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a3f1a169-46b9-48a7-8e07-91e68eed722a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:13.052066 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a3f1a169-46b9-48a7-8e07-91e68eed722a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:13.057228 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a3f1a169-46b9-48a7-8e07-91e68eed722a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:13.057611 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a3f1a169-46b9-48a7-8e07-91e68eed722a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:13.058405 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a3f1a169-46b9-48a7-8e07-91e68eed722a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:13.058841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a3f1a169-46b9-48a7-8e07-91e68eed722a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:13.205030 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-a3f1a169-46b9-48a7-8e07-91e68eed722a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:13.212933 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a3f1a169-46b9-48a7-8e07-91e68eed722a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1515 microversion: 2.1 time: 0.165955 Aug 30 08:02:13.213526 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 807/1564] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:13 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:14.231148 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f74fdd4c-79bc-418c-835e-ee5c8f66b317 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:14.231768 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f74fdd4c-79bc-418c-835e-ee5c8f66b317 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:14.237574 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f74fdd4c-79bc-418c-835e-ee5c8f66b317 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:14.238015 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f74fdd4c-79bc-418c-835e-ee5c8f66b317 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:14.238806 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f74fdd4c-79bc-418c-835e-ee5c8f66b317 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:14.239238 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f74fdd4c-79bc-418c-835e-ee5c8f66b317 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:14.287881 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-23704df5-2f4f-4767-a769-1946a78dc757 req-261a5fc7-12e8-4391-b708-fbdbf0667a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7a4654-a0be-4fa9-b45b-acbd7ba764e9", "name": "network-vif-unplugged", "status": "completed", "tag": "df6e2650-791e-4b79-8911-dc23e2079687"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:02:14.289427 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:02:14.289427 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 08:02:14.296814 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-23704df5-2f4f-4767-a769-1946a78dc757 req-261a5fc7-12e8-4391-b708-fbdbf0667a1f service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:14.297981 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-23704df5-2f4f-4767-a769-1946a78dc757 req-261a5fc7-12e8-4391-b708-fbdbf0667a1f service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:14.310574 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-23704df5-2f4f-4767-a769-1946a78dc757 req-261a5fc7-12e8-4391-b708-fbdbf0667a1f service nova] Creating event network-vif-unplugged:df6e2650-791e-4b79-8911-dc23e2079687 for instance 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 on hv-cinder-80619 Aug 30 08:02:14.319873 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-23704df5-2f4f-4767-a769-1946a78dc757 req-261a5fc7-12e8-4391-b708-fbdbf0667a1f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034785 Aug 30 08:02:14.320488 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 808/1565] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:02:14 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 08:02:14.376706 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f74fdd4c-79bc-418c-835e-ee5c8f66b317 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:14.385227 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f74fdd4c-79bc-418c-835e-ee5c8f66b317 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1573 microversion: 2.1 time: 0.157780 Aug 30 08:02:14.385799 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 758/1566] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:14 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:15.403429 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-1e20ffde-8caf-4676-9249-68c3f3bd5541 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:15.404133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-1e20ffde-8caf-4676-9249-68c3f3bd5541 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:15.410191 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e20ffde-8caf-4676-9249-68c3f3bd5541 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:15.410640 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e20ffde-8caf-4676-9249-68c3f3bd5541 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:15.411400 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e20ffde-8caf-4676-9249-68c3f3bd5541 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:15.412350 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-1e20ffde-8caf-4676-9249-68c3f3bd5541 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:15.530083 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-1e20ffde-8caf-4676-9249-68c3f3bd5541 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:15.538003 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-1e20ffde-8caf-4676-9249-68c3f3bd5541 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1573 microversion: 2.1 time: 0.138614 Aug 30 08:02:15.538582 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 809/1567] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:15 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1573 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:16.555301 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f9354ab9-6801-42fc-93e3-b0080a565025 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:16.555910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f9354ab9-6801-42fc-93e3-b0080a565025 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:16.561661 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f9354ab9-6801-42fc-93e3-b0080a565025 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:16.562101 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f9354ab9-6801-42fc-93e3-b0080a565025 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:16.562885 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f9354ab9-6801-42fc-93e3-b0080a565025 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:16.563312 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f9354ab9-6801-42fc-93e3-b0080a565025 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:16.685065 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f9354ab9-6801-42fc-93e3-b0080a565025 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:16.694069 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f9354ab9-6801-42fc-93e3-b0080a565025 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1573 microversion: 2.1 time: 0.143130 Aug 30 08:02:16.695344 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 759/1568] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:16 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1573 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:17.713147 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-aa798cfb-c771-4f5e-838a-2048bc179d4e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:17.713823 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-aa798cfb-c771-4f5e-838a-2048bc179d4e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:17.719662 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa798cfb-c771-4f5e-838a-2048bc179d4e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:17.720109 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa798cfb-c771-4f5e-838a-2048bc179d4e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:17.720870 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa798cfb-c771-4f5e-838a-2048bc179d4e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:17.721312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-aa798cfb-c771-4f5e-838a-2048bc179d4e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:17.837438 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-aa798cfb-c771-4f5e-838a-2048bc179d4e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:17.844644 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-aa798cfb-c771-4f5e-838a-2048bc179d4e tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1573 microversion: 2.1 time: 0.135820 Aug 30 08:02:17.845191 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 810/1569] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:17 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1573 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:18.861854 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9f2cad6b-e693-4d7f-9962-50e36087f58f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:18.862510 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9f2cad6b-e693-4d7f-9962-50e36087f58f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:18.869044 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9f2cad6b-e693-4d7f-9962-50e36087f58f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:18.869492 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9f2cad6b-e693-4d7f-9962-50e36087f58f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:18.870294 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9f2cad6b-e693-4d7f-9962-50e36087f58f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:18.870736 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9f2cad6b-e693-4d7f-9962-50e36087f58f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:18.989696 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9f2cad6b-e693-4d7f-9962-50e36087f58f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:18.997618 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9f2cad6b-e693-4d7f-9962-50e36087f58f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1573 microversion: 2.1 time: 0.139433 Aug 30 08:02:18.998205 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 760/1570] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:18 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1573 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:20.015269 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9eb6092e-853f-44e7-944b-60e4323519b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:20.015878 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9eb6092e-853f-44e7-944b-60e4323519b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:20.021635 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9eb6092e-853f-44e7-944b-60e4323519b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:20.022080 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9eb6092e-853f-44e7-944b-60e4323519b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:20.023499 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9eb6092e-853f-44e7-944b-60e4323519b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:20.023928 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9eb6092e-853f-44e7-944b-60e4323519b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:20.145314 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-9eb6092e-853f-44e7-944b-60e4323519b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:20.153783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9eb6092e-853f-44e7-944b-60e4323519b2 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1573 microversion: 2.1 time: 0.141920 Aug 30 08:02:20.154546 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 811/1571] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:20 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1573 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:21.170746 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-04986ad3-faea-47b3-99d1-46c89d474c45 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:21.171366 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-04986ad3-faea-47b3-99d1-46c89d474c45 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:21.177164 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-04986ad3-faea-47b3-99d1-46c89d474c45 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:21.177613 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-04986ad3-faea-47b3-99d1-46c89d474c45 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:21.178400 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-04986ad3-faea-47b3-99d1-46c89d474c45 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:21.179327 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-04986ad3-faea-47b3-99d1-46c89d474c45 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:21.300671 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-04986ad3-faea-47b3-99d1-46c89d474c45 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:21.308559 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-04986ad3-faea-47b3-99d1-46c89d474c45 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1573 microversion: 2.1 time: 0.141532 Aug 30 08:02:21.309125 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 761/1572] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:21 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1573 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:22.326783 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b69e0c28-0a69-4f4a-8505-7870dea53ae4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:22.327401 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b69e0c28-0a69-4f4a-8505-7870dea53ae4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:22.333026 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b69e0c28-0a69-4f4a-8505-7870dea53ae4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:22.333470 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b69e0c28-0a69-4f4a-8505-7870dea53ae4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:22.334252 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b69e0c28-0a69-4f4a-8505-7870dea53ae4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:22.334681 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b69e0c28-0a69-4f4a-8505-7870dea53ae4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:22.457861 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b69e0c28-0a69-4f4a-8505-7870dea53ae4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:22.465369 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b69e0c28-0a69-4f4a-8505-7870dea53ae4 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1573 microversion: 2.1 time: 0.142571 Aug 30 08:02:22.465930 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 812/1573] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:22 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1573 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:23.482457 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-63f61c1a-d7f4-4b8e-8c5f-85573433682a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:23.483101 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-63f61c1a-d7f4-4b8e-8c5f-85573433682a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:23.488846 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-63f61c1a-d7f4-4b8e-8c5f-85573433682a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:23.489288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-63f61c1a-d7f4-4b8e-8c5f-85573433682a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:23.490040 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-63f61c1a-d7f4-4b8e-8c5f-85573433682a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:23.490497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-63f61c1a-d7f4-4b8e-8c5f-85573433682a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:23.607757 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-63f61c1a-d7f4-4b8e-8c5f-85573433682a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:23.615085 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-63f61c1a-d7f4-4b8e-8c5f-85573433682a tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1573 microversion: 2.1 time: 0.136332 Aug 30 08:02:23.615639 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 762/1574] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:23 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1573 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:24.416132 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-13441860-a028-44e4-baaf-6cd5cd56df9b req-c5da1cf6-3911-4427-8d68-c2900f377d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7a4654-a0be-4fa9-b45b-acbd7ba764e9", "name": "network-vif-plugged", "status": "completed", "tag": "df6e2650-791e-4b79-8911-dc23e2079687"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:02:24.417648 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:02:24.417648 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 08:02:24.424475 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-13441860-a028-44e4-baaf-6cd5cd56df9b req-c5da1cf6-3911-4427-8d68-c2900f377d25 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:24.424980 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-13441860-a028-44e4-baaf-6cd5cd56df9b req-c5da1cf6-3911-4427-8d68-c2900f377d25 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:24.436739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-13441860-a028-44e4-baaf-6cd5cd56df9b req-c5da1cf6-3911-4427-8d68-c2900f377d25 service nova] Creating event network-vif-plugged:df6e2650-791e-4b79-8911-dc23e2079687 for instance 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 on hv-cinder-80619 Aug 30 08:02:24.441677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-13441860-a028-44e4-baaf-6cd5cd56df9b req-c5da1cf6-3911-4427-8d68-c2900f377d25 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029774 Aug 30 08:02:24.442281 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 813/1575] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:02:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:02:24.631927 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-9205e879-2629-4602-8651-c8d3818e1ea7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:24.632683 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-9205e879-2629-4602-8651-c8d3818e1ea7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:24.639299 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9205e879-2629-4602-8651-c8d3818e1ea7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:24.639739 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9205e879-2629-4602-8651-c8d3818e1ea7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:24.640715 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9205e879-2629-4602-8651-c8d3818e1ea7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:24.641180 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-9205e879-2629-4602-8651-c8d3818e1ea7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:24.777326 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-9205e879-2629-4602-8651-c8d3818e1ea7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:24.784446 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-9205e879-2629-4602-8651-c8d3818e1ea7 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1573 microversion: 2.1 time: 0.156287 Aug 30 08:02:24.785009 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 763/1576] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:24 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:25.803081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7e519cdb-eabb-4fb3-9e4d-6563e638b042 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:25.803789 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7e519cdb-eabb-4fb3-9e4d-6563e638b042 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:25.810436 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7e519cdb-eabb-4fb3-9e4d-6563e638b042 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:25.810891 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7e519cdb-eabb-4fb3-9e4d-6563e638b042 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:25.811664 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7e519cdb-eabb-4fb3-9e4d-6563e638b042 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:25.812099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7e519cdb-eabb-4fb3-9e4d-6563e638b042 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:25.932569 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7e519cdb-eabb-4fb3-9e4d-6563e638b042 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:25.940403 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7e519cdb-eabb-4fb3-9e4d-6563e638b042 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1573 microversion: 2.1 time: 0.141366 Aug 30 08:02:25.940973 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 814/1577] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:25 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1573 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:02:26.956752 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-05b8cc44-acf9-4d6f-b8fc-e7fa93c9b832 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:02:26.957362 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-05b8cc44-acf9-4d6f-b8fc-e7fa93c9b832 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:02:26.963902 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05b8cc44-acf9-4d6f-b8fc-e7fa93c9b832 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:26.964345 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05b8cc44-acf9-4d6f-b8fc-e7fa93c9b832 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:26.965103 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05b8cc44-acf9-4d6f-b8fc-e7fa93c9b832 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:02:26.965533 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-05b8cc44-acf9-4d6f-b8fc-e7fa93c9b832 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:02:27.082617 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-05b8cc44-acf9-4d6f-b8fc-e7fa93c9b832 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:02:27.090442 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-05b8cc44-acf9-4d6f-b8fc-e7fa93c9b832 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1560 microversion: 2.1 time: 0.137468 Aug 30 08:02:27.091003 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 764/1578] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:02:26 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1560 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:38.747653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2f58087-b47d-4874-a504-33ae8103f10a] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 08:03:38.752284 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5a8c7a24-73bb-4d99-8375-3d2c54af7ad6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:38.752787 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5a8c7a24-73bb-4d99-8375-3d2c54af7ad6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:38.758669 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a8c7a24-73bb-4d99-8375-3d2c54af7ad6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:38.759122 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a8c7a24-73bb-4d99-8375-3d2c54af7ad6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:38.759888 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a8c7a24-73bb-4d99-8375-3d2c54af7ad6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:38.760326 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a8c7a24-73bb-4d99-8375-3d2c54af7ad6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:38.784616 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5a8c7a24-73bb-4d99-8375-3d2c54af7ad6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 08:03:38.860090 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5a8c7a24-73bb-4d99-8375-3d2c54af7ad6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 204 len: 0 microversion: 2.1 time: 0.114305 Aug 30 08:03:38.860684 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 815/1579] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 08:03:38 2021] DELETE /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 08:03:38.868288 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [926fbc4d-903d-4d96-bec4-b35eb2ef22f6] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 08:03:38.871892 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-644acff1-9189-4387-9b6e-e3cd59085b3c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:38.872499 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-644acff1-9189-4387-9b6e-e3cd59085b3c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:38.879139 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-644acff1-9189-4387-9b6e-e3cd59085b3c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:38.879581 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-644acff1-9189-4387-9b6e-e3cd59085b3c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:38.880329 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-644acff1-9189-4387-9b6e-e3cd59085b3c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:38.880756 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-644acff1-9189-4387-9b6e-e3cd59085b3c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:39.135008 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-644acff1-9189-4387-9b6e-e3cd59085b3c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:39.142365 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-644acff1-9189-4387-9b6e-e3cd59085b3c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1577 microversion: 2.1 time: 0.277194 Aug 30 08:03:39.142917 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 765/1580] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:38 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1577 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:40.159686 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5a5d2ca7-ebb9-4ac2-af22-33f192a6a938 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:40.160497 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5a5d2ca7-ebb9-4ac2-af22-33f192a6a938 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:40.179727 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a5d2ca7-ebb9-4ac2-af22-33f192a6a938 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:40.180181 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a5d2ca7-ebb9-4ac2-af22-33f192a6a938 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:40.180964 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a5d2ca7-ebb9-4ac2-af22-33f192a6a938 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:40.181402 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5a5d2ca7-ebb9-4ac2-af22-33f192a6a938 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:40.184981 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2f58087-b47d-4874-a504-33ae8103f10a] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 34562. Aug 30 08:03:40.360904 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5a5d2ca7-ebb9-4ac2-af22-33f192a6a938 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:40.368159 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5a5d2ca7-ebb9-4ac2-af22-33f192a6a938 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1577 microversion: 2.1 time: 0.213175 Aug 30 08:03:40.368725 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 816/1581] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:40 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1577 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 08:03:41.386485 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d8e1445e-9d0e-4c2a-88a3-e5feaf417f5a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:41.387111 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d8e1445e-9d0e-4c2a-88a3-e5feaf417f5a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:41.404599 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8e1445e-9d0e-4c2a-88a3-e5feaf417f5a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:41.405058 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8e1445e-9d0e-4c2a-88a3-e5feaf417f5a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:41.406436 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8e1445e-9d0e-4c2a-88a3-e5feaf417f5a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:41.406926 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d8e1445e-9d0e-4c2a-88a3-e5feaf417f5a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:41.423186 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] [926fbc4d-903d-4d96-bec4-b35eb2ef22f6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 34570. Aug 30 08:03:41.434248 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-969166c8-d1cf-48e5-892e-59f04cedc985 req-082622f6-29a8-4346-8b5e-bb5376e64885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4547bc1-f924-47d7-b393-dc33089c1398", "name": "network-vif-deleted", "tag": "c02f326b-8b5a-4810-9334-a2d508d1d10e"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:03:41.436463 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:03:41.436463 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 08:03:41.446083 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-969166c8-d1cf-48e5-892e-59f04cedc985 req-082622f6-29a8-4346-8b5e-bb5376e64885 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:41.446560 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-969166c8-d1cf-48e5-892e-59f04cedc985 req-082622f6-29a8-4346-8b5e-bb5376e64885 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:41.461563 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-969166c8-d1cf-48e5-892e-59f04cedc985 req-082622f6-29a8-4346-8b5e-bb5376e64885 service nova] Creating event network-vif-deleted:c02f326b-8b5a-4810-9334-a2d508d1d10e for instance d4547bc1-f924-47d7-b393-dc33089c1398 on hv-cinder-80619 Aug 30 08:03:41.467183 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-969166c8-d1cf-48e5-892e-59f04cedc985 req-082622f6-29a8-4346-8b5e-bb5376e64885 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036498 Aug 30 08:03:41.467956 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 817/1582] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:03:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 08:03:41.479046 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d8e1445e-9d0e-4c2a-88a3-e5feaf417f5a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:41.488495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d8e1445e-9d0e-4c2a-88a3-e5feaf417f5a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 200 len: 1509 microversion: 2.1 time: 0.105608 Aug 30 08:03:41.489608 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 766/1583] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:41 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 1509 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:42.506493 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9c42485d-2ce1-48f3-8eb4-19038aca8ff3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:42.507198 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9c42485d-2ce1-48f3-8eb4-19038aca8ff3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:42.513201 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c42485d-2ce1-48f3-8eb4-19038aca8ff3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:42.513646 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c42485d-2ce1-48f3-8eb4-19038aca8ff3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:42.514491 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c42485d-2ce1-48f3-8eb4-19038aca8ff3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:42.514925 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9c42485d-2ce1-48f3-8eb4-19038aca8ff3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:42.527750 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-9c42485d-2ce1-48f3-8eb4-19038aca8ff3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] HTTP exception thrown: Instance d4547bc1-f924-47d7-b393-dc33089c1398 could not be found. Aug 30 08:03:42.528330 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9c42485d-2ce1-48f3-8eb4-19038aca8ff3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Returning 404 to user: Instance d4547bc1-f924-47d7-b393-dc33089c1398 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 08:03:42.529144 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9c42485d-2ce1-48f3-8eb4-19038aca8ff3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 404 len: 111 microversion: 2.1 time: 0.027010 Aug 30 08:03:42.529654 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 818/1584] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:42 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 08:03:42.620523 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1751739821", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-465833747", "security_groups": [{"name": "tempest-secgroup-smoke-2102052867"}], "block_device_mapping_v2": [{"uuid": "05bb33ed-3224-498f-a974-1d3c0e5cfe58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f9bdf19d-4247-4c5d-a0b9-ca04cf41736f"}]}} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:03:42.722656 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.network.neutron [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] validate_networks() for [('f9bdf19d-4247-4c5d-a0b9-ca04cf41736f', None, None, None, None, None)] {{(pid=114670) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 08:03:43.322530 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Flavor limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 08:03:43.322952 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Image limits 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 08:03:43.323430 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Flavor pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 08:03:43.323835 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Image pref 0:0:0 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 08:03:43.324243 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.virt.hardware [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 08:03:43.333187 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:43.333624 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:43.334444 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:43.334876 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:43.351006 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Getting quotas for project 8d8bc861de4e4b05b9e798f101735072. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 08:03:43.354823 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.quota [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Getting quotas for user 88b988bf652b4658acaa6d7b74d37f9b and project 8d8bc861de4e4b05b9e798f101735072. Resources: {'cores', 'ram', 'instances'} {{(pid=114670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 08:03:43.413012 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Going to run 1 instances... {{(pid=114670) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 08:03:43.415209 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='05bb33ed-3224-498f-a974-1d3c0e5cfe58',volume_size=None,volume_type=None)] {{(pid=114670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 08:03:43.538569 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8f2a349f-42e5-4725-9dfc-dc8bd3d356a6 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.921620 Aug 30 08:03:43.539208 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 767/1585] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 08:03:42 2021] POST /compute/v2.1/servers => generated 406 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 08:03:43.549232 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-63a6d3de-a00a-401e-8c59-05440f32165e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:43.549848 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-63a6d3de-a00a-401e-8c59-05440f32165e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:43.601638 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-63a6d3de-a00a-401e-8c59-05440f32165e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:43.608256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-63a6d3de-a00a-401e-8c59-05440f32165e tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1094 microversion: 2.1 time: 0.063164 Aug 30 08:03:43.609422 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 819/1586] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:43 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:44.626361 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-aba8c434-96f2-4d84-adcc-64a623839921 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:44.627340 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-aba8c434-96f2-4d84-adcc-64a623839921 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:44.633383 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aba8c434-96f2-4d84-adcc-64a623839921 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:44.633910 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aba8c434-96f2-4d84-adcc-64a623839921 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:44.634816 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aba8c434-96f2-4d84-adcc-64a623839921 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:44.635331 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-aba8c434-96f2-4d84-adcc-64a623839921 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:44.735171 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-aba8c434-96f2-4d84-adcc-64a623839921 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:44.747182 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-aba8c434-96f2-4d84-adcc-64a623839921 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1210 microversion: 2.1 time: 0.125728 Aug 30 08:03:44.747792 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 768/1587] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:44 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1210 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:45.737330 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-9a0e9847-2c7d-49c8-b44b-50cc8d7318e6 req-97e30c79-5c73-49a4-803c-ae169d0a1393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1ada03-0d0a-4904-81cc-6a75b3efc8c5", "tag": "a50ced59-7bc3-43d9-a76e-2fcb84480280"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:03:45.739614 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:03:45.739614 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 08:03:45.747863 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-9a0e9847-2c7d-49c8-b44b-50cc8d7318e6 req-97e30c79-5c73-49a4-803c-ae169d0a1393 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:45.748804 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-9a0e9847-2c7d-49c8-b44b-50cc8d7318e6 req-97e30c79-5c73-49a4-803c-ae169d0a1393 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:45.762840 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-9a0e9847-2c7d-49c8-b44b-50cc8d7318e6 req-97e30c79-5c73-49a4-803c-ae169d0a1393 service nova] Creating event network-changed:a50ced59-7bc3-43d9-a76e-2fcb84480280 for instance 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 on hv-cinder-80619 Aug 30 08:03:45.769383 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-9a0e9847-2c7d-49c8-b44b-50cc8d7318e6 req-97e30c79-5c73-49a4-803c-ae169d0a1393 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035777 Aug 30 08:03:45.770659 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 820/1588] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:03:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:03:45.777486 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-0609be90-c10c-4841-b119-7d30a74389a5 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:45.781927 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-0609be90-c10c-4841-b119-7d30a74389a5 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:45.791586 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0609be90-c10c-4841-b119-7d30a74389a5 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:45.792017 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0609be90-c10c-4841-b119-7d30a74389a5 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:45.793024 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0609be90-c10c-4841-b119-7d30a74389a5 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:45.793634 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-0609be90-c10c-4841-b119-7d30a74389a5 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:45.993045 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-0609be90-c10c-4841-b119-7d30a74389a5 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:46.000791 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-0609be90-c10c-4841-b119-7d30a74389a5 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.238320 Aug 30 08:03:46.001348 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 769/1589] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:45 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:47.018278 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7476ddec-2792-42b3-980f-1e0ed695ca26 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:47.018919 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7476ddec-2792-42b3-980f-1e0ed695ca26 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:47.024954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7476ddec-2792-42b3-980f-1e0ed695ca26 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:47.025395 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7476ddec-2792-42b3-980f-1e0ed695ca26 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:47.026170 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7476ddec-2792-42b3-980f-1e0ed695ca26 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:47.026606 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7476ddec-2792-42b3-980f-1e0ed695ca26 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:47.145004 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-7476ddec-2792-42b3-980f-1e0ed695ca26 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:47.152230 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7476ddec-2792-42b3-980f-1e0ed695ca26 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.138208 Aug 30 08:03:47.152789 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 821/1590] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:47 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:48.169328 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-c4ffcab8-f152-4a65-9479-98a86d7736eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:48.169950 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-c4ffcab8-f152-4a65-9479-98a86d7736eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:48.176394 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4ffcab8-f152-4a65-9479-98a86d7736eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:48.176846 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4ffcab8-f152-4a65-9479-98a86d7736eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:48.177613 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4ffcab8-f152-4a65-9479-98a86d7736eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:48.178052 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-c4ffcab8-f152-4a65-9479-98a86d7736eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:48.296266 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-c4ffcab8-f152-4a65-9479-98a86d7736eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:48.304401 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-c4ffcab8-f152-4a65-9479-98a86d7736eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.138773 Aug 30 08:03:48.304964 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 770/1591] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:48 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:49.320887 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5d240786-33f9-4ca5-868f-33465208a8f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:49.321413 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5d240786-33f9-4ca5-868f-33465208a8f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:49.327312 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d240786-33f9-4ca5-868f-33465208a8f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:49.327823 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d240786-33f9-4ca5-868f-33465208a8f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:49.329081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d240786-33f9-4ca5-868f-33465208a8f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:49.329513 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5d240786-33f9-4ca5-868f-33465208a8f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:49.445226 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5d240786-33f9-4ca5-868f-33465208a8f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:49.452367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5d240786-33f9-4ca5-868f-33465208a8f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.135263 Aug 30 08:03:49.452954 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 822/1592] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:49 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:50.469173 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-bb396473-9ede-48bc-881b-47382c3a81e3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:50.469798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-bb396473-9ede-48bc-881b-47382c3a81e3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:50.475692 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bb396473-9ede-48bc-881b-47382c3a81e3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:50.476143 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bb396473-9ede-48bc-881b-47382c3a81e3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:50.476914 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bb396473-9ede-48bc-881b-47382c3a81e3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:50.477353 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-bb396473-9ede-48bc-881b-47382c3a81e3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:50.594872 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-bb396473-9ede-48bc-881b-47382c3a81e3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:50.602059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-bb396473-9ede-48bc-881b-47382c3a81e3 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.136876 Aug 30 08:03:50.602651 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 771/1593] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:50 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 08:03:51.619081 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-55a982fb-2ca3-4fc2-8ad2-9633b5390d09 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:51.619697 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-55a982fb-2ca3-4fc2-8ad2-9633b5390d09 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:51.625481 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-55a982fb-2ca3-4fc2-8ad2-9633b5390d09 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:51.625927 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-55a982fb-2ca3-4fc2-8ad2-9633b5390d09 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:51.626713 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-55a982fb-2ca3-4fc2-8ad2-9633b5390d09 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:51.627152 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-55a982fb-2ca3-4fc2-8ad2-9633b5390d09 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:51.752687 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-55a982fb-2ca3-4fc2-8ad2-9633b5390d09 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:51.759812 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-55a982fb-2ca3-4fc2-8ad2-9633b5390d09 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.144437 Aug 30 08:03:51.760367 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 823/1594] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:51 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:52.776931 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a4d14f9c-c5fd-4742-b76f-ddaf5a814806 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:52.777587 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a4d14f9c-c5fd-4742-b76f-ddaf5a814806 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:52.784104 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a4d14f9c-c5fd-4742-b76f-ddaf5a814806 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:52.784552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a4d14f9c-c5fd-4742-b76f-ddaf5a814806 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:52.785311 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a4d14f9c-c5fd-4742-b76f-ddaf5a814806 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:52.785798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a4d14f9c-c5fd-4742-b76f-ddaf5a814806 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:52.905340 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a4d14f9c-c5fd-4742-b76f-ddaf5a814806 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:52.913004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a4d14f9c-c5fd-4742-b76f-ddaf5a814806 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.139789 Aug 30 08:03:52.913570 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 772/1595] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:52 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:53.930262 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b04b6a39-3ab1-4d42-a4d6-085a96520e96 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:53.930906 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b04b6a39-3ab1-4d42-a4d6-085a96520e96 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:53.936645 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b04b6a39-3ab1-4d42-a4d6-085a96520e96 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:53.937142 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b04b6a39-3ab1-4d42-a4d6-085a96520e96 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:53.938551 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b04b6a39-3ab1-4d42-a4d6-085a96520e96 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:53.938984 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b04b6a39-3ab1-4d42-a4d6-085a96520e96 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:54.061870 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b04b6a39-3ab1-4d42-a4d6-085a96520e96 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:54.069633 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b04b6a39-3ab1-4d42-a4d6-085a96520e96 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.143068 Aug 30 08:03:54.070208 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 824/1596] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:53 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:55.085780 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-b8ac7a18-3a2f-477c-b9b2-074fcad5504b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:55.086431 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-b8ac7a18-3a2f-477c-b9b2-074fcad5504b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:55.092314 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8ac7a18-3a2f-477c-b9b2-074fcad5504b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:55.092767 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8ac7a18-3a2f-477c-b9b2-074fcad5504b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:55.094650 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8ac7a18-3a2f-477c-b9b2-074fcad5504b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:55.095109 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-b8ac7a18-3a2f-477c-b9b2-074fcad5504b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:55.216109 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-b8ac7a18-3a2f-477c-b9b2-074fcad5504b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:55.224310 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-b8ac7a18-3a2f-477c-b9b2-074fcad5504b tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.142154 Aug 30 08:03:55.224887 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 773/1597] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:55 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:56.243712 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3b8da4cc-2978-4522-a5a0-1220378da2e9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:56.244273 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3b8da4cc-2978-4522-a5a0-1220378da2e9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:56.251017 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3b8da4cc-2978-4522-a5a0-1220378da2e9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:56.251467 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3b8da4cc-2978-4522-a5a0-1220378da2e9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:56.252238 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3b8da4cc-2978-4522-a5a0-1220378da2e9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:56.252951 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-3b8da4cc-2978-4522-a5a0-1220378da2e9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:56.375579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3b8da4cc-2978-4522-a5a0-1220378da2e9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:56.383049 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3b8da4cc-2978-4522-a5a0-1220378da2e9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.143101 Aug 30 08:03:56.383615 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 825/1598] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:56 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:57.399618 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-3d9c7f44-4afb-4f22-b02d-d73804c47db0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:57.400268 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-3d9c7f44-4afb-4f22-b02d-d73804c47db0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:57.406000 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3d9c7f44-4afb-4f22-b02d-d73804c47db0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:57.406487 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3d9c7f44-4afb-4f22-b02d-d73804c47db0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:57.407264 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3d9c7f44-4afb-4f22-b02d-d73804c47db0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:57.407704 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-3d9c7f44-4afb-4f22-b02d-d73804c47db0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:57.528298 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-3d9c7f44-4afb-4f22-b02d-d73804c47db0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:57.535587 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-3d9c7f44-4afb-4f22-b02d-d73804c47db0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.139666 Aug 30 08:03:57.536099 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 774/1599] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:57 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:58.552009 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e0e4451c-be2a-4c3c-90bf-5712e9b65e34 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:58.552630 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e0e4451c-be2a-4c3c-90bf-5712e9b65e34 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:58.558444 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0e4451c-be2a-4c3c-90bf-5712e9b65e34 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:58.558891 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0e4451c-be2a-4c3c-90bf-5712e9b65e34 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:58.559653 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0e4451c-be2a-4c3c-90bf-5712e9b65e34 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:58.560087 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e0e4451c-be2a-4c3c-90bf-5712e9b65e34 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:58.690522 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-e0e4451c-be2a-4c3c-90bf-5712e9b65e34 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:58.697645 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e0e4451c-be2a-4c3c-90bf-5712e9b65e34 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.149343 Aug 30 08:03:58.698247 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 826/1600] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:58 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:03:58.777911 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-0b14d855-1a7d-403e-8372-093267d938ed req-3188cce2-1f8a-498e-820a-842c2817a669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1ada03-0d0a-4904-81cc-6a75b3efc8c5", "name": "network-vif-plugged", "status": "completed", "tag": "a50ced59-7bc3-43d9-a76e-2fcb84480280"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:03:58.779589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:03:58.779589 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 08:03:58.786922 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-0b14d855-1a7d-403e-8372-093267d938ed req-3188cce2-1f8a-498e-820a-842c2817a669 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:58.787459 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-0b14d855-1a7d-403e-8372-093267d938ed req-3188cce2-1f8a-498e-820a-842c2817a669 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:58.799140 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-0b14d855-1a7d-403e-8372-093267d938ed req-3188cce2-1f8a-498e-820a-842c2817a669 service nova] Creating event network-vif-plugged:a50ced59-7bc3-43d9-a76e-2fcb84480280 for instance 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 on hv-cinder-80619 Aug 30 08:03:58.804324 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-0b14d855-1a7d-403e-8372-093267d938ed req-3188cce2-1f8a-498e-820a-842c2817a669 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029919 Aug 30 08:03:58.805004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 775/1601] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:03:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:03:59.714255 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5b2dec1d-52e2-4bf7-9a5d-2507310f0749 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:03:59.714869 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5b2dec1d-52e2-4bf7-9a5d-2507310f0749 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:03:59.720805 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b2dec1d-52e2-4bf7-9a5d-2507310f0749 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:59.721244 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b2dec1d-52e2-4bf7-9a5d-2507310f0749 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:59.721995 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b2dec1d-52e2-4bf7-9a5d-2507310f0749 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:03:59.722461 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-5b2dec1d-52e2-4bf7-9a5d-2507310f0749 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:03:59.840195 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5b2dec1d-52e2-4bf7-9a5d-2507310f0749 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:03:59.847996 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5b2dec1d-52e2-4bf7-9a5d-2507310f0749 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1266 microversion: 2.1 time: 0.137463 Aug 30 08:03:59.848551 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 827/1602] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:03:59 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:04:00.865230 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-27279035-c428-4d40-aeed-a04cef422cb1 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:04:00.865845 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-27279035-c428-4d40-aeed-a04cef422cb1 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:04:00.871840 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27279035-c428-4d40-aeed-a04cef422cb1 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:00.872281 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27279035-c428-4d40-aeed-a04cef422cb1 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:00.873033 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27279035-c428-4d40-aeed-a04cef422cb1 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:00.873465 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-27279035-c428-4d40-aeed-a04cef422cb1 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:00.992874 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-27279035-c428-4d40-aeed-a04cef422cb1 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:04:01.001092 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-27279035-c428-4d40-aeed-a04cef422cb1 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1453 microversion: 2.1 time: 0.139500 Aug 30 08:04:01.001661 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 776/1603] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:04:00 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:04:01.017678 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4b22e29e-40f8-4fdb-ac81-dca517ed6bda tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:04:01.018328 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4b22e29e-40f8-4fdb-ac81-dca517ed6bda tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:04:01.024038 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b22e29e-40f8-4fdb-ac81-dca517ed6bda tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:01.024484 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b22e29e-40f8-4fdb-ac81-dca517ed6bda tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:01.025244 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b22e29e-40f8-4fdb-ac81-dca517ed6bda tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:01.025679 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4b22e29e-40f8-4fdb-ac81-dca517ed6bda tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:01.141815 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4b22e29e-40f8-4fdb-ac81-dca517ed6bda tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:04:01.149083 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4b22e29e-40f8-4fdb-ac81-dca517ed6bda tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1453 microversion: 2.1 time: 0.135740 Aug 30 08:04:01.149638 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 828/1604] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:04:01 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:04:03.022988 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-16a65b65-7588-4c28-84b3-819a56a70ec0 req-df59e94d-8429-447e-b044-07f9ac265bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1ada03-0d0a-4904-81cc-6a75b3efc8c5", "tag": "a50ced59-7bc3-43d9-a76e-2fcb84480280"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:04:03.024503 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:04:03.024503 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 08:04:03.031278 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-16a65b65-7588-4c28-84b3-819a56a70ec0 req-df59e94d-8429-447e-b044-07f9ac265bc8 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:03.031723 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-16a65b65-7588-4c28-84b3-819a56a70ec0 req-df59e94d-8429-447e-b044-07f9ac265bc8 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:03.042476 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-16a65b65-7588-4c28-84b3-819a56a70ec0 req-df59e94d-8429-447e-b044-07f9ac265bc8 service nova] Creating event network-changed:a50ced59-7bc3-43d9-a76e-2fcb84480280 for instance 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 on hv-cinder-80619 Aug 30 08:04:03.047612 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-16a65b65-7588-4c28-84b3-819a56a70ec0 req-df59e94d-8429-447e-b044-07f9ac265bc8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088941 Aug 30 08:04:03.048761 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 777/1605] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:04:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:04:04.062197 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-7419f25b-8a47-427e-970d-214a7354502f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:04:04.062705 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7419f25b-8a47-427e-970d-214a7354502f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:04:04.069478 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7419f25b-8a47-427e-970d-214a7354502f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:04.069922 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7419f25b-8a47-427e-970d-214a7354502f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:04.070701 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7419f25b-8a47-427e-970d-214a7354502f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:04.071130 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-7419f25b-8a47-427e-970d-214a7354502f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:04.095441 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-7419f25b-8a47-427e-970d-214a7354502f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 08:04:04.169256 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-7419f25b-8a47-427e-970d-214a7354502f tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 204 len: 0 microversion: 2.1 time: 0.110401 Aug 30 08:04:04.170083 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 829/1606] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 08:04:04 2021] DELETE /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 08:04:04.178576 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f5d25b8e-c1d1-441c-912c-b53673676079 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:04:04.179287 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f5d25b8e-c1d1-441c-912c-b53673676079 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:04:04.185244 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5d25b8e-c1d1-441c-912c-b53673676079 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:04.185696 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5d25b8e-c1d1-441c-912c-b53673676079 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:04.186497 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5d25b8e-c1d1-441c-912c-b53673676079 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:04.186938 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f5d25b8e-c1d1-441c-912c-b53673676079 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:04.311410 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f5d25b8e-c1d1-441c-912c-b53673676079 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:04:04.319456 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f5d25b8e-c1d1-441c-912c-b53673676079 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.144902 Aug 30 08:04:04.320037 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 778/1607] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:04:04 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:04:05.063756 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-4e8ee581-defb-46a2-bb1f-4e9429a32905 req-9bc4cec2-e1b3-43a7-a838-423d994804e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f7a4654-a0be-4fa9-b45b-acbd7ba764e9", "tag": "df6e2650-791e-4b79-8911-dc23e2079687"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:04:05.065240 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:04:05.065240 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 08:04:05.072001 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-4e8ee581-defb-46a2-bb1f-4e9429a32905 req-9bc4cec2-e1b3-43a7-a838-423d994804e8 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:05.072450 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-4e8ee581-defb-46a2-bb1f-4e9429a32905 req-9bc4cec2-e1b3-43a7-a838-423d994804e8 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:05.083745 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-4e8ee581-defb-46a2-bb1f-4e9429a32905 req-9bc4cec2-e1b3-43a7-a838-423d994804e8 service nova] Creating event network-changed:df6e2650-791e-4b79-8911-dc23e2079687 for instance 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 on hv-cinder-80619 Aug 30 08:04:05.088635 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-4e8ee581-defb-46a2-bb1f-4e9429a32905 req-9bc4cec2-e1b3-43a7-a838-423d994804e8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028919 Aug 30 08:04:05.089212 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 830/1608] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:04:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:04:05.337551 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-f6a8f3de-e520-4be9-9c0e-0734e5de1b31 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:04:05.338223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-f6a8f3de-e520-4be9-9c0e-0734e5de1b31 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:04:05.344058 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6a8f3de-e520-4be9-9c0e-0734e5de1b31 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:05.344515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6a8f3de-e520-4be9-9c0e-0734e5de1b31 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:05.345961 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6a8f3de-e520-4be9-9c0e-0734e5de1b31 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:05.346422 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-f6a8f3de-e520-4be9-9c0e-0734e5de1b31 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:05.531885 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-f6a8f3de-e520-4be9-9c0e-0734e5de1b31 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:04:05.539630 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-f6a8f3de-e520-4be9-9c0e-0734e5de1b31 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1566 microversion: 2.1 time: 0.205999 Aug 30 08:04:05.540203 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 779/1609] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:04:05 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:04:06.437159 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-8f411c56-7a07-48fc-a267-04603cc8b999 req-23e88d93-9add-4750-8640-a90ebc102890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7a4654-a0be-4fa9-b45b-acbd7ba764e9", "name": "network-vif-deleted", "tag": "df6e2650-791e-4b79-8911-dc23e2079687"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:04:06.439126 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:04:06.439126 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 08:04:06.447834 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-8f411c56-7a07-48fc-a267-04603cc8b999 req-23e88d93-9add-4750-8640-a90ebc102890 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:06.448292 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-8f411c56-7a07-48fc-a267-04603cc8b999 req-23e88d93-9add-4750-8640-a90ebc102890 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:06.460989 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-8f411c56-7a07-48fc-a267-04603cc8b999 req-23e88d93-9add-4750-8640-a90ebc102890 service nova] Creating event network-vif-deleted:df6e2650-791e-4b79-8911-dc23e2079687 for instance 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 on hv-cinder-80619 Aug 30 08:04:06.467546 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-8f411c56-7a07-48fc-a267-04603cc8b999 req-23e88d93-9add-4750-8640-a90ebc102890 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034953 Aug 30 08:04:06.468076 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 831/1610] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:04:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:04:06.556516 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5d79e734-e9b2-43c9-8cf1-76fdba242329 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:04:06.557132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5d79e734-e9b2-43c9-8cf1-76fdba242329 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:04:06.562887 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5d79e734-e9b2-43c9-8cf1-76fdba242329 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:06.563333 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5d79e734-e9b2-43c9-8cf1-76fdba242329 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:06.564284 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5d79e734-e9b2-43c9-8cf1-76fdba242329 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:06.564720 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5d79e734-e9b2-43c9-8cf1-76fdba242329 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:06.623657 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5d79e734-e9b2-43c9-8cf1-76fdba242329 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a305429eb64d259972aae774b6d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748b4459c5b4b0eb1eae5f1a86e1d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:04:06.631267 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5d79e734-e9b2-43c9-8cf1-76fdba242329 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 200 len: 1219 microversion: 2.1 time: 0.078361 Aug 30 08:04:06.631832 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 780/1611] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:04:06 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:04:07.649273 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ce61668d-bbbf-418b-bd05-b4f7bb0217a8 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:04:07.650056 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-ce61668d-bbbf-418b-bd05-b4f7bb0217a8 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] [instance: 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:04:07.656404 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce61668d-bbbf-418b-bd05-b4f7bb0217a8 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:07.656855 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce61668d-bbbf-418b-bd05-b4f7bb0217a8 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:07.657668 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce61668d-bbbf-418b-bd05-b4f7bb0217a8 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:04:07.658059 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-ce61668d-bbbf-418b-bd05-b4f7bb0217a8 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:04:07.672099 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-ce61668d-bbbf-418b-bd05-b4f7bb0217a8 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] HTTP exception thrown: Instance 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 could not be found. Aug 30 08:04:07.672691 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-ce61668d-bbbf-418b-bd05-b4f7bb0217a8 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Returning 404 to user: Instance 5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 08:04:07.673828 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-ce61668d-bbbf-418b-bd05-b4f7bb0217a8 tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9" status: 404 len: 111 microversion: 2.1 time: 0.028963 Aug 30 08:04:07.674390 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 832/1612] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:04:07 2021] GET /compute/v2.1/servers/5f7a4654-a0be-4fa9-b45b-acbd7ba764e9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 08:04:07.831399 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-98295684-85a8-4be8-9b15-691e21fd1a2b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] Calling method '.version_select at 0x7f341c1ca8b0>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:04:07.850403 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-98295684-85a8-4be8-9b15-691e21fd1a2b tempest-TestShelveInstance-1305674687 tempest-TestShelveInstance-1305674687-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-763817541" status: 202 len: 0 microversion: 2.1 time: 0.023485 Aug 30 08:04:07.851658 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 781/1613] 10.222.0.73 () {58 vars in 1251 bytes} [Mon Aug 30 08:04:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-763817541 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 08:06:02.780156 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1512956790", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-465833747", "security_groups": [{"name": "tempest-secgroup-smoke-2102052867"}], "block_device_mapping_v2": [{"uuid": "307b75b1-8b7a-4488-8336-941aa630d910", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f9bdf19d-4247-4c5d-a0b9-ca04cf41736f"}]}} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:06:02.882361 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.network.neutron [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] validate_networks() for [('f9bdf19d-4247-4c5d-a0b9-ca04cf41736f', None, None, None, None, None)] {{(pid=114671) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 30 08:06:03.332503 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Flavor limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 08:06:03.332925 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Image limits 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 08:06:03.333394 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Flavor pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 08:06:03.333799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Image pref 0:0:0 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 08:06:03.334267 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.virt.hardware [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=114671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 08:06:03.342624 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:03.343065 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:03.343854 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:03.344324 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:03.360747 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Getting quotas for project 8d8bc861de4e4b05b9e798f101735072. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 30 08:06:03.364581 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.quota [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Getting quotas for user 88b988bf652b4658acaa6d7b74d37f9b and project 8d8bc861de4e4b05b9e798f101735072. Resources: {'cores', 'ram', 'instances'} {{(pid=114671) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 30 08:06:03.423288 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Going to run 1 instances... {{(pid=114671) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 30 08:06:03.425437 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='307b75b1-8b7a-4488-8336-941aa630d910',volume_size=None,volume_type=None)] {{(pid=114671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 30 08:06:03.542538 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [4794119c-2122-449d-97d2-ccf4dd74830e] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 08:06:04.559765 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO oslo.messaging._drivers.impl_rabbit [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [4794119c-2122-449d-97d2-ccf4dd74830e] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 34794. Aug 30 08:06:04.563820 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-a1adcf7b-f63d-41af-be0c-2916d3c8d5f8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.788170 Aug 30 08:06:04.569231 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 833/1614] 10.222.0.73 () {60 vars in 1147 bytes} [Mon Aug 30 08:06:02 2021] POST /compute/v2.1/servers => generated 406 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 08:06:04.572785 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [926fbc4d-903d-4d96-bec4-b35eb2ef22f6] AMQP server on 10.222.0.73:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 08:06:04.577071 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d1307832-d153-456d-9eca-52fbe0e7aa54 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:04.577682 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d1307832-d153-456d-9eca-52fbe0e7aa54 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:04.629901 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d1307832-d153-456d-9eca-52fbe0e7aa54 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:04.637444 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d1307832-d153-456d-9eca-52fbe0e7aa54 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1094 microversion: 2.1 time: 0.066789 Aug 30 08:06:04.637985 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 782/1615] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:04 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:05.654095 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-5207e973-30a5-49fe-8366-239efb5e29fa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:05.654800 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-5207e973-30a5-49fe-8366-239efb5e29fa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:05.709456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-5207e973-30a5-49fe-8366-239efb5e29fa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:05.716047 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-5207e973-30a5-49fe-8366-239efb5e29fa tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1094 microversion: 2.1 time: 0.065613 Aug 30 08:06:05.716609 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 834/1616] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:05 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:06.732792 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-abd97607-1d1e-4c61-9515-c409f8d8d77f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:06.733414 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-abd97607-1d1e-4c61-9515-c409f8d8d77f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:06.755550 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] [926fbc4d-903d-4d96-bec4-b35eb2ef22f6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 34814. Aug 30 08:06:06.799083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-abd97607-1d1e-4c61-9515-c409f8d8d77f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:06.805442 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-abd97607-1d1e-4c61-9515-c409f8d8d77f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1094 microversion: 2.1 time: 0.076353 Aug 30 08:06:06.805993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 783/1617] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:06 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:07.821826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-3da4a80a-6fb3-476d-b218-f82344cd5aa2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:07.822466 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-3da4a80a-6fb3-476d-b218-f82344cd5aa2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:07.877744 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-3da4a80a-6fb3-476d-b218-f82344cd5aa2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:07.884498 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-3da4a80a-6fb3-476d-b218-f82344cd5aa2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1094 microversion: 2.1 time: 0.066419 Aug 30 08:06:07.885379 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 835/1618] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:07 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:08.901816 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-fe68ed44-5455-4b14-94e5-9d5f8b163079 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:08.902490 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-fe68ed44-5455-4b14-94e5-9d5f8b163079 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:08.908863 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fe68ed44-5455-4b14-94e5-9d5f8b163079 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:08.909313 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fe68ed44-5455-4b14-94e5-9d5f8b163079 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:08.910081 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fe68ed44-5455-4b14-94e5-9d5f8b163079 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:08.910541 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-fe68ed44-5455-4b14-94e5-9d5f8b163079 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:08.971872 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-fe68ed44-5455-4b14-94e5-9d5f8b163079 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:08.979192 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-fe68ed44-5455-4b14-94e5-9d5f8b163079 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1144 microversion: 2.1 time: 0.081065 Aug 30 08:06:08.979751 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 784/1619] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:08 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 08:06:09.997494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-d85a3c20-ce30-4cd3-a458-b3c26d07d580 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:09.998173 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-d85a3c20-ce30-4cd3-a458-b3c26d07d580 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:10.004665 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d85a3c20-ce30-4cd3-a458-b3c26d07d580 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:10.005107 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d85a3c20-ce30-4cd3-a458-b3c26d07d580 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:10.006079 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d85a3c20-ce30-4cd3-a458-b3c26d07d580 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:10.006535 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-d85a3c20-ce30-4cd3-a458-b3c26d07d580 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:10.073036 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-d85a3c20-ce30-4cd3-a458-b3c26d07d580 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:10.082575 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-d85a3c20-ce30-4cd3-a458-b3c26d07d580 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1210 microversion: 2.1 time: 0.090008 Aug 30 08:06:10.083228 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 836/1620] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:09 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:11.100071 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-a782d064-7f61-417f-a5f5-f2cc297adbb8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:11.100651 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-a782d064-7f61-417f-a5f5-f2cc297adbb8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:11.106417 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a782d064-7f61-417f-a5f5-f2cc297adbb8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:11.106874 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a782d064-7f61-417f-a5f5-f2cc297adbb8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:11.107648 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a782d064-7f61-417f-a5f5-f2cc297adbb8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:11.108090 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-a782d064-7f61-417f-a5f5-f2cc297adbb8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:11.443414 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-a782d064-7f61-417f-a5f5-f2cc297adbb8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:11.450934 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-a782d064-7f61-417f-a5f5-f2cc297adbb8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.354654 Aug 30 08:06:11.451507 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 785/1621] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:11 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:11.738774 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-6f73f929-9272-4f10-b955-0dabb08c71e5 req-f2449180-982d-47a4-a214-f883dc5d2fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a629c8b8-7384-45a1-8361-22c8be3a0a94", "tag": "dcb4a4db-0173-4723-b40e-151177eb93e8"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:06:11.740385 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:06:11.740385 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 08:06:11.747388 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-6f73f929-9272-4f10-b955-0dabb08c71e5 req-f2449180-982d-47a4-a214-f883dc5d2fca service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:11.747856 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-6f73f929-9272-4f10-b955-0dabb08c71e5 req-f2449180-982d-47a4-a214-f883dc5d2fca service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:11.760105 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-6f73f929-9272-4f10-b955-0dabb08c71e5 req-f2449180-982d-47a4-a214-f883dc5d2fca service nova] Creating event network-changed:dcb4a4db-0173-4723-b40e-151177eb93e8 for instance a629c8b8-7384-45a1-8361-22c8be3a0a94 on hv-cinder-80619 Aug 30 08:06:11.765236 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-6f73f929-9272-4f10-b955-0dabb08c71e5 req-f2449180-982d-47a4-a214-f883dc5d2fca service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169273 Aug 30 08:06:11.766005 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 837/1622] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:06:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:06:12.467818 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-703e8970-2da4-45d4-a3b3-5c6fa845bb59 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:12.468438 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-703e8970-2da4-45d4-a3b3-5c6fa845bb59 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:12.474954 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-703e8970-2da4-45d4-a3b3-5c6fa845bb59 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:12.475404 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-703e8970-2da4-45d4-a3b3-5c6fa845bb59 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:12.476164 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-703e8970-2da4-45d4-a3b3-5c6fa845bb59 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:12.476652 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-703e8970-2da4-45d4-a3b3-5c6fa845bb59 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:12.637295 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-703e8970-2da4-45d4-a3b3-5c6fa845bb59 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:12.645219 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-703e8970-2da4-45d4-a3b3-5c6fa845bb59 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.181108 Aug 30 08:06:12.645826 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 786/1623] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:12 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:12.826358 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 08:06:12.826897 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: Mon Aug 30 08:06:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 08:06:13.663286 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-98deec0a-ac16-4247-8c21-fce1114cc53f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:13.663976 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-98deec0a-ac16-4247-8c21-fce1114cc53f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:13.669968 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-98deec0a-ac16-4247-8c21-fce1114cc53f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:13.670441 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-98deec0a-ac16-4247-8c21-fce1114cc53f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:13.671196 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-98deec0a-ac16-4247-8c21-fce1114cc53f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:13.671625 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-98deec0a-ac16-4247-8c21-fce1114cc53f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:13.791516 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-98deec0a-ac16-4247-8c21-fce1114cc53f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:13.798841 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-98deec0a-ac16-4247-8c21-fce1114cc53f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.139643 Aug 30 08:06:13.799391 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 838/1624] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:13 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:13.887789 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 08:06:13.888495 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: Mon Aug 30 08:06:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 08:06:14.814931 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-78a70419-e740-4ef8-97be-6f127682ff81 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:14.815547 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-78a70419-e740-4ef8-97be-6f127682ff81 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:14.821401 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78a70419-e740-4ef8-97be-6f127682ff81 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:14.821851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78a70419-e740-4ef8-97be-6f127682ff81 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:14.822636 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78a70419-e740-4ef8-97be-6f127682ff81 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:14.823076 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-78a70419-e740-4ef8-97be-6f127682ff81 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:14.940357 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-78a70419-e740-4ef8-97be-6f127682ff81 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:14.947592 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-78a70419-e740-4ef8-97be-6f127682ff81 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.136751 Aug 30 08:06:14.948157 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 787/1625] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:14 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:15.964920 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-faa213e0-fcf5-438f-8b4a-ddc36727fe28 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:15.965559 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-faa213e0-fcf5-438f-8b4a-ddc36727fe28 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:15.972219 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-faa213e0-fcf5-438f-8b4a-ddc36727fe28 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:15.972663 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-faa213e0-fcf5-438f-8b4a-ddc36727fe28 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:15.973419 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-faa213e0-fcf5-438f-8b4a-ddc36727fe28 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:15.973847 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-faa213e0-fcf5-438f-8b4a-ddc36727fe28 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:16.090772 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-faa213e0-fcf5-438f-8b4a-ddc36727fe28 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:16.098492 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-faa213e0-fcf5-438f-8b4a-ddc36727fe28 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.137190 Aug 30 08:06:16.099051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 839/1626] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:15 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:17.115627 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-5a116911-1377-4502-a7c6-f6ea4b4a279f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:17.116233 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-5a116911-1377-4502-a7c6-f6ea4b4a279f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:17.122059 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5a116911-1377-4502-a7c6-f6ea4b4a279f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:17.122531 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5a116911-1377-4502-a7c6-f6ea4b4a279f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:17.123291 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5a116911-1377-4502-a7c6-f6ea4b4a279f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:17.123721 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-5a116911-1377-4502-a7c6-f6ea4b4a279f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:17.243318 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-5a116911-1377-4502-a7c6-f6ea4b4a279f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:17.250517 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-5a116911-1377-4502-a7c6-f6ea4b4a279f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.138515 Aug 30 08:06:17.251069 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 788/1627] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:17 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:18.268135 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-424406f8-8c84-4a39-8501-8adefd3a9cec tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:18.268759 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-424406f8-8c84-4a39-8501-8adefd3a9cec tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:18.274579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-424406f8-8c84-4a39-8501-8adefd3a9cec tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:18.275022 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-424406f8-8c84-4a39-8501-8adefd3a9cec tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:18.275784 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-424406f8-8c84-4a39-8501-8adefd3a9cec tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:18.276217 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-424406f8-8c84-4a39-8501-8adefd3a9cec tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:18.396826 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-424406f8-8c84-4a39-8501-8adefd3a9cec tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:18.404079 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-424406f8-8c84-4a39-8501-8adefd3a9cec tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.140348 Aug 30 08:06:18.404641 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 840/1628] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:18 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:19.420887 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-d67b221f-0d08-4b6a-bb29-2ea7cfe05a83 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:19.421507 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-d67b221f-0d08-4b6a-bb29-2ea7cfe05a83 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:19.427347 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d67b221f-0d08-4b6a-bb29-2ea7cfe05a83 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:19.427795 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d67b221f-0d08-4b6a-bb29-2ea7cfe05a83 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:19.428555 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d67b221f-0d08-4b6a-bb29-2ea7cfe05a83 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:19.428992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-d67b221f-0d08-4b6a-bb29-2ea7cfe05a83 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:19.545461 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-d67b221f-0d08-4b6a-bb29-2ea7cfe05a83 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:19.552685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-d67b221f-0d08-4b6a-bb29-2ea7cfe05a83 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.135550 Aug 30 08:06:19.553251 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 789/1629] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:19 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:20.569298 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-c2474df5-107f-491c-a3bd-d33653f07a31 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:20.569918 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-c2474df5-107f-491c-a3bd-d33653f07a31 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:20.575860 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2474df5-107f-491c-a3bd-d33653f07a31 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:20.576296 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2474df5-107f-491c-a3bd-d33653f07a31 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:20.577058 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2474df5-107f-491c-a3bd-d33653f07a31 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:20.577496 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-c2474df5-107f-491c-a3bd-d33653f07a31 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:20.695253 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-c2474df5-107f-491c-a3bd-d33653f07a31 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:20.702384 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-c2474df5-107f-491c-a3bd-d33653f07a31 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.136724 Aug 30 08:06:20.702938 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 841/1630] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:20 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:21.720454 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-45552c56-7d08-47ca-aab3-4e92a981842d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:21.720997 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-45552c56-7d08-47ca-aab3-4e92a981842d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:21.728798 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-45552c56-7d08-47ca-aab3-4e92a981842d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:21.729269 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-45552c56-7d08-47ca-aab3-4e92a981842d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:21.730053 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-45552c56-7d08-47ca-aab3-4e92a981842d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:21.730711 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-45552c56-7d08-47ca-aab3-4e92a981842d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:21.849353 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-45552c56-7d08-47ca-aab3-4e92a981842d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:21.857040 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-45552c56-7d08-47ca-aab3-4e92a981842d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.141042 Aug 30 08:06:21.857622 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 790/1631] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:21 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:22.874433 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-4fbb90d3-d735-4e74-84ba-29fa706614eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:22.875053 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-4fbb90d3-d735-4e74-84ba-29fa706614eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:22.881833 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4fbb90d3-d735-4e74-84ba-29fa706614eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:22.882322 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4fbb90d3-d735-4e74-84ba-29fa706614eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:22.883108 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4fbb90d3-d735-4e74-84ba-29fa706614eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:22.883530 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-4fbb90d3-d735-4e74-84ba-29fa706614eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:23.000241 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-4fbb90d3-d735-4e74-84ba-29fa706614eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:23.008235 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-4fbb90d3-d735-4e74-84ba-29fa706614eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.137497 Aug 30 08:06:23.008790 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 842/1632] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:22 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:23.598560 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-e24dda56-8260-4a23-ba12-01a45fe84fec req-78863132-5d84-4c1a-8888-0cd75ad48e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a629c8b8-7384-45a1-8361-22c8be3a0a94", "name": "network-vif-plugged", "status": "completed", "tag": "dcb4a4db-0173-4723-b40e-151177eb93e8"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:06:23.600191 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:06:23.600191 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 08:06:23.607004 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-e24dda56-8260-4a23-ba12-01a45fe84fec req-78863132-5d84-4c1a-8888-0cd75ad48e89 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:23.607448 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-e24dda56-8260-4a23-ba12-01a45fe84fec req-78863132-5d84-4c1a-8888-0cd75ad48e89 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:23.619781 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-e24dda56-8260-4a23-ba12-01a45fe84fec req-78863132-5d84-4c1a-8888-0cd75ad48e89 service nova] Creating event network-vif-plugged:dcb4a4db-0173-4723-b40e-151177eb93e8 for instance a629c8b8-7384-45a1-8361-22c8be3a0a94 on hv-cinder-80619 Aug 30 08:06:23.623217 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: ERROR oslo.messaging._drivers.impl_rabbit [req-e24dda56-8260-4a23-ba12-01a45fe84fec req-78863132-5d84-4c1a-8888-0cd75ad48e89 service nova] [e76f6de7-0f22-4c28-af30-c1e65279411d] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 08:06:24.024666 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-185f8417-aa09-4908-b83e-b9a892d6b0eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:24.025220 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-185f8417-aa09-4908-b83e-b9a892d6b0eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:24.031121 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-185f8417-aa09-4908-b83e-b9a892d6b0eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:24.031577 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-185f8417-aa09-4908-b83e-b9a892d6b0eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:24.032333 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-185f8417-aa09-4908-b83e-b9a892d6b0eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:24.032764 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-185f8417-aa09-4908-b83e-b9a892d6b0eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:24.151639 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-185f8417-aa09-4908-b83e-b9a892d6b0eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:24.158962 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-185f8417-aa09-4908-b83e-b9a892d6b0eb tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.138034 Aug 30 08:06:24.159521 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 843/1633] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:24 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 08:06:24.640381 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [req-e24dda56-8260-4a23-ba12-01a45fe84fec req-78863132-5d84-4c1a-8888-0cd75ad48e89 service nova] [e76f6de7-0f22-4c28-af30-c1e65279411d] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 34868. Aug 30 08:06:24.643738 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-e24dda56-8260-4a23-ba12-01a45fe84fec req-78863132-5d84-4c1a-8888-0cd75ad48e89 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.107648 Aug 30 08:06:24.644366 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 791/1634] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:06:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:06:25.175799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-2e539fd9-062e-4c5b-99a9-5624da6e14d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:25.176365 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-2e539fd9-062e-4c5b-99a9-5624da6e14d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:25.182546 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e539fd9-062e-4c5b-99a9-5624da6e14d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:25.183205 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e539fd9-062e-4c5b-99a9-5624da6e14d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:25.184227 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e539fd9-062e-4c5b-99a9-5624da6e14d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:25.184665 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-2e539fd9-062e-4c5b-99a9-5624da6e14d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:25.302792 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-2e539fd9-062e-4c5b-99a9-5624da6e14d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:25.309946 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-2e539fd9-062e-4c5b-99a9-5624da6e14d2 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1266 microversion: 2.1 time: 0.138030 Aug 30 08:06:25.310531 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 844/1635] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:25 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:26.327511 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-8d754e38-2144-48a5-a7fd-16838ecfbed8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:26.328214 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-8d754e38-2144-48a5-a7fd-16838ecfbed8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:26.334333 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8d754e38-2144-48a5-a7fd-16838ecfbed8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:26.334789 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8d754e38-2144-48a5-a7fd-16838ecfbed8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:26.335572 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8d754e38-2144-48a5-a7fd-16838ecfbed8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:26.335993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-8d754e38-2144-48a5-a7fd-16838ecfbed8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:26.456621 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-8d754e38-2144-48a5-a7fd-16838ecfbed8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:26.463852 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-8d754e38-2144-48a5-a7fd-16838ecfbed8 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1454 microversion: 2.1 time: 0.140419 Aug 30 08:06:26.464409 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 792/1636] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:26 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:26.480205 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-8cdd59f2-df72-4113-a559-fb4b81f67f69 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:06:26.480817 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-8cdd59f2-df72-4113-a559-fb4b81f67f69 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:06:26.486610 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8cdd59f2-df72-4113-a559-fb4b81f67f69 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:26.487051 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8cdd59f2-df72-4113-a559-fb4b81f67f69 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:26.487807 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8cdd59f2-df72-4113-a559-fb4b81f67f69 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:26.488236 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-8cdd59f2-df72-4113-a559-fb4b81f67f69 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:26.604738 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-8cdd59f2-df72-4113-a559-fb4b81f67f69 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:06:26.612042 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-8cdd59f2-df72-4113-a559-fb4b81f67f69 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1454 microversion: 2.1 time: 0.135483 Aug 30 08:06:26.612593 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 845/1637] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:06:26 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:06:28.516799 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-7284fe1c-5bec-43e7-b713-3bad1a0de873 req-6887bfc7-73c2-4459-bb36-fad2302275e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a629c8b8-7384-45a1-8361-22c8be3a0a94", "tag": "dcb4a4db-0173-4723-b40e-151177eb93e8"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:06:28.518500 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:06:28.518500 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 08:06:28.525239 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-7284fe1c-5bec-43e7-b713-3bad1a0de873 req-6887bfc7-73c2-4459-bb36-fad2302275e1 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:06:28.525685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-7284fe1c-5bec-43e7-b713-3bad1a0de873 req-6887bfc7-73c2-4459-bb36-fad2302275e1 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:06:28.537441 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-7284fe1c-5bec-43e7-b713-3bad1a0de873 req-6887bfc7-73c2-4459-bb36-fad2302275e1 service nova] Creating event network-changed:dcb4a4db-0173-4723-b40e-151177eb93e8 for instance a629c8b8-7384-45a1-8361-22c8be3a0a94 on hv-cinder-80619 Aug 30 08:06:28.542553 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-7284fe1c-5bec-43e7-b713-3bad1a0de873 req-6887bfc7-73c2-4459-bb36-fad2302275e1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029906 Aug 30 08:06:28.543319 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 793/1638] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:06:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:08:18.576248 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2f58087-b47d-4874-a504-33ae8103f10a] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 08:08:18.580865 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-38a3b11b-7d29-4645-8dba-b840bce5ae0c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:18.581041 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [926fbc4d-903d-4d96-bec4-b35eb2ef22f6] AMQP server on 10.222.0.73:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 08:08:18.581437 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-38a3b11b-7d29-4645-8dba-b840bce5ae0c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:18.584957 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-b11d3909-26a1-43d2-8a9e-2f14dc98cd1d req-d0f17391-5270-48a4-9394-2c6f40e5a19e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a629c8b8-7384-45a1-8361-22c8be3a0a94", "tag": "dcb4a4db-0173-4723-b40e-151177eb93e8"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:08:18.586634 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:08:18.586634 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 08:08:18.587408 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-38a3b11b-7d29-4645-8dba-b840bce5ae0c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:18.587857 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-38a3b11b-7d29-4645-8dba-b840bce5ae0c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:18.588628 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-38a3b11b-7d29-4645-8dba-b840bce5ae0c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:18.589064 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-38a3b11b-7d29-4645-8dba-b840bce5ae0c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:18.593766 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-b11d3909-26a1-43d2-8a9e-2f14dc98cd1d req-d0f17391-5270-48a4-9394-2c6f40e5a19e service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:18.594515 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-b11d3909-26a1-43d2-8a9e-2f14dc98cd1d req-d0f17391-5270-48a4-9394-2c6f40e5a19e service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:18.605745 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-b11d3909-26a1-43d2-8a9e-2f14dc98cd1d req-d0f17391-5270-48a4-9394-2c6f40e5a19e service nova] Creating event network-changed:dcb4a4db-0173-4723-b40e-151177eb93e8 for instance a629c8b8-7384-45a1-8361-22c8be3a0a94 on hv-cinder-80619 Aug 30 08:08:18.611015 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-b11d3909-26a1-43d2-8a9e-2f14dc98cd1d req-d0f17391-5270-48a4-9394-2c6f40e5a19e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033227 Aug 30 08:08:18.611794 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 794/1639] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:08:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:08:18.614956 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-38a3b11b-7d29-4645-8dba-b840bce5ae0c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 08:08:18.702799 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-38a3b11b-7d29-4645-8dba-b840bce5ae0c tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 204 len: 0 microversion: 2.1 time: 0.127830 Aug 30 08:08:18.703743 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 846/1640] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 08:08:18 2021] DELETE /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 08:08:18.713217 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-57bd527a-9ba0-4e0f-a072-d355f0860e9f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:18.714316 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-57bd527a-9ba0-4e0f-a072-d355f0860e9f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:18.721814 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-57bd527a-9ba0-4e0f-a072-d355f0860e9f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:18.722536 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-57bd527a-9ba0-4e0f-a072-d355f0860e9f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:18.723513 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-57bd527a-9ba0-4e0f-a072-d355f0860e9f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:18.724132 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-57bd527a-9ba0-4e0f-a072-d355f0860e9f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:18.929365 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-57bd527a-9ba0-4e0f-a072-d355f0860e9f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:08:18.936993 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-57bd527a-9ba0-4e0f-a072-d355f0860e9f tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1578 microversion: 2.1 time: 0.227809 Aug 30 08:08:18.937562 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 795/1641] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:08:18 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1578 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:08:19.956467 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-b565c102-5aed-44f1-b178-8e99f7a81ce0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:19.957201 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-b565c102-5aed-44f1-b178-8e99f7a81ce0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:19.974950 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b565c102-5aed-44f1-b178-8e99f7a81ce0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:19.975394 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b565c102-5aed-44f1-b178-8e99f7a81ce0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:19.976171 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b565c102-5aed-44f1-b178-8e99f7a81ce0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:19.976606 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-b565c102-5aed-44f1-b178-8e99f7a81ce0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:19.981668 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2f58087-b47d-4874-a504-33ae8103f10a] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 34938. Aug 30 08:08:20.099712 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-b565c102-5aed-44f1-b178-8e99f7a81ce0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:08:20.107031 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-b565c102-5aed-44f1-b178-8e99f7a81ce0 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1460 microversion: 2.1 time: 0.154851 Aug 30 08:08:20.107590 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 847/1642] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:08:19 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1460 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:08:21.124749 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-2b13207d-ea28-491c-a35a-a8ac936abc6d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:21.125401 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-2b13207d-ea28-491c-a35a-a8ac936abc6d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:21.146083 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b13207d-ea28-491c-a35a-a8ac936abc6d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:21.146616 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b13207d-ea28-491c-a35a-a8ac936abc6d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:21.147400 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b13207d-ea28-491c-a35a-a8ac936abc6d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:21.147837 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-2b13207d-ea28-491c-a35a-a8ac936abc6d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:21.152908 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] [926fbc4d-903d-4d96-bec4-b35eb2ef22f6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 34942. Aug 30 08:08:21.355640 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-2b13207d-ea28-491c-a35a-a8ac936abc6d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:08:21.364652 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-2b13207d-ea28-491c-a35a-a8ac936abc6d tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 200 len: 1460 microversion: 2.1 time: 0.243650 Aug 30 08:08:21.365221 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 796/1643] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:08:21 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 1460 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:08:21.369794 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [req-4c61b1e8-c885-4efa-8b1c-a50ea2bdec6a req-e89d8387-21c5-4552-8ae8-ac482f72f966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a629c8b8-7384-45a1-8361-22c8be3a0a94", "name": "network-vif-deleted", "tag": "dcb4a4db-0173-4723-b40e-151177eb93e8"}]} {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:08:21.371318 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:08:21.371318 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: warnings.warn(msg) Aug 30 08:08:21.378430 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-4c61b1e8-c885-4efa-8b1c-a50ea2bdec6a req-e89d8387-21c5-4552-8ae8-ac482f72f966 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:21.378877 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [req-4c61b1e8-c885-4efa-8b1c-a50ea2bdec6a req-e89d8387-21c5-4552-8ae8-ac482f72f966 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:21.389419 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.compute.server_external_events [req-4c61b1e8-c885-4efa-8b1c-a50ea2bdec6a req-e89d8387-21c5-4552-8ae8-ac482f72f966 service nova] Creating event network-vif-deleted:dcb4a4db-0173-4723-b40e-151177eb93e8 for instance a629c8b8-7384-45a1-8361-22c8be3a0a94 on hv-cinder-80619 Aug 30 08:08:21.394673 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [req-4c61b1e8-c885-4efa-8b1c-a50ea2bdec6a req-e89d8387-21c5-4552-8ae8-ac482f72f966 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028408 Aug 30 08:08:21.395305 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 848/1644] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:08:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:08:22.381311 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4235a849-57dd-46bb-9332-0448966d89d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:22.381974 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-4235a849-57dd-46bb-9332-0448966d89d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: a629c8b8-7384-45a1-8361-22c8be3a0a94] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:22.387907 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4235a849-57dd-46bb-9332-0448966d89d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:22.388349 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4235a849-57dd-46bb-9332-0448966d89d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:22.389109 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4235a849-57dd-46bb-9332-0448966d89d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:22.389537 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-4235a849-57dd-46bb-9332-0448966d89d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:22.402818 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-4235a849-57dd-46bb-9332-0448966d89d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] HTTP exception thrown: Instance a629c8b8-7384-45a1-8361-22c8be3a0a94 could not be found. Aug 30 08:08:22.403394 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-4235a849-57dd-46bb-9332-0448966d89d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Returning 404 to user: Instance a629c8b8-7384-45a1-8361-22c8be3a0a94 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 08:08:22.404198 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-4235a849-57dd-46bb-9332-0448966d89d7 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94" status: 404 len: 111 microversion: 2.1 time: 0.026909 Aug 30 08:08:22.404703 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 797/1645] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:08:22 2021] GET /compute/v2.1/servers/a629c8b8-7384-45a1-8361-22c8be3a0a94 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 08:08:25.439084 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-9dcde91a-e7ae-4c16-8956-01c9c486bf0a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:25.439739 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9dcde91a-e7ae-4c16-8956-01c9c486bf0a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:25.440851 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-fbbb8a38-2bd5-41a7-93d3-26a37c20d80f req-186474fa-81e7-457d-96a6-ad9d135297df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1ada03-0d0a-4904-81cc-6a75b3efc8c5", "tag": "a50ced59-7bc3-43d9-a76e-2fcb84480280"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:08:25.442419 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:08:25.442419 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 08:08:25.446074 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9dcde91a-e7ae-4c16-8956-01c9c486bf0a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:25.446634 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9dcde91a-e7ae-4c16-8956-01c9c486bf0a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:25.447494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9dcde91a-e7ae-4c16-8956-01c9c486bf0a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:25.448133 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-9dcde91a-e7ae-4c16-8956-01c9c486bf0a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:25.449100 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-fbbb8a38-2bd5-41a7-93d3-26a37c20d80f req-186474fa-81e7-457d-96a6-ad9d135297df service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:25.449576 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-fbbb8a38-2bd5-41a7-93d3-26a37c20d80f req-186474fa-81e7-457d-96a6-ad9d135297df service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:25.461556 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-fbbb8a38-2bd5-41a7-93d3-26a37c20d80f req-186474fa-81e7-457d-96a6-ad9d135297df service nova] Creating event network-changed:a50ced59-7bc3-43d9-a76e-2fcb84480280 for instance 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 on hv-cinder-80619 Aug 30 08:08:25.467154 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-fbbb8a38-2bd5-41a7-93d3-26a37c20d80f req-186474fa-81e7-457d-96a6-ad9d135297df service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029977 Aug 30 08:08:25.472594 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 798/1646] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:08:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:08:25.475804 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-9dcde91a-e7ae-4c16-8956-01c9c486bf0a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Going to try to terminate instance {{(pid=114671) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 30 08:08:25.562762 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-9dcde91a-e7ae-4c16-8956-01c9c486bf0a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 204 len: 0 microversion: 2.1 time: 0.127434 Aug 30 08:08:25.563688 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 849/1647] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 08:08:25 2021] DELETE /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 08:08:25.572193 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-1826efd3-8625-4c08-ab73-2eaa7f65f444 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:25.573342 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-1826efd3-8625-4c08-ab73-2eaa7f65f444 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:25.592124 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1826efd3-8625-4c08-ab73-2eaa7f65f444 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:25.592578 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1826efd3-8625-4c08-ab73-2eaa7f65f444 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:25.593368 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1826efd3-8625-4c08-ab73-2eaa7f65f444 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:25.594007 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-1826efd3-8625-4c08-ab73-2eaa7f65f444 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:25.800723 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.policy [None req-1826efd3-8625-4c08-ab73-2eaa7f65f444 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114670) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:08:25.809552 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-1826efd3-8625-4c08-ab73-2eaa7f65f444 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1578 microversion: 2.1 time: 0.241525 Aug 30 08:08:25.810131 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 799/1648] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:08:25 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 08:08:26.827759 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-adf5490f-a731-4bce-a77e-ad6ad5c746cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:26.828375 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-adf5490f-a731-4bce-a77e-ad6ad5c746cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:26.834712 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-adf5490f-a731-4bce-a77e-ad6ad5c746cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:26.835154 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-adf5490f-a731-4bce-a77e-ad6ad5c746cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:26.835903 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-adf5490f-a731-4bce-a77e-ad6ad5c746cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:26.836329 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-adf5490f-a731-4bce-a77e-ad6ad5c746cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:26.956057 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-adf5490f-a731-4bce-a77e-ad6ad5c746cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:08:26.963319 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-adf5490f-a731-4bce-a77e-ad6ad5c746cc tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1459 microversion: 2.1 time: 0.139647 Aug 30 08:08:26.963881 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 850/1649] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:08:26 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1459 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:08:27.782880 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [req-733de78e-aed1-4d86-b03d-f01b9e8df603 req-64db2ea9-af09-471d-9568-4ced673302a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1ada03-0d0a-4904-81cc-6a75b3efc8c5", "name": "network-vif-deleted", "tag": "a50ced59-7bc3-43d9-a76e-2fcb84480280"}]} {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 08:08:27.784387 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 08:08:27.784387 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: warnings.warn(msg) Aug 30 08:08:27.791565 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-733de78e-aed1-4d86-b03d-f01b9e8df603 req-64db2ea9-af09-471d-9568-4ced673302a6 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:27.791999 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [req-733de78e-aed1-4d86-b03d-f01b9e8df603 req-64db2ea9-af09-471d-9568-4ced673302a6 service nova] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:27.805685 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.compute.server_external_events [req-733de78e-aed1-4d86-b03d-f01b9e8df603 req-64db2ea9-af09-471d-9568-4ced673302a6 service nova] Creating event network-vif-deleted:a50ced59-7bc3-43d9-a76e-2fcb84480280 for instance 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 on hv-cinder-80619 Aug 30 08:08:27.812235 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [req-733de78e-aed1-4d86-b03d-f01b9e8df603 req-64db2ea9-af09-471d-9568-4ced673302a6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033570 Aug 30 08:08:27.812827 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 800/1650] 10.222.0.73 () {64 vars in 1318 bytes} [Mon Aug 30 08:08:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 08:08:27.980696 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-faad175b-8bca-42fb-8376-8dc5b2c0c941 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:27.981317 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-faad175b-8bca-42fb-8376-8dc5b2c0c941 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:27.987911 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-faad175b-8bca-42fb-8376-8dc5b2c0c941 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:27.988300 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-faad175b-8bca-42fb-8376-8dc5b2c0c941 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:27.989061 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-faad175b-8bca-42fb-8376-8dc5b2c0c941 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:27.989494 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-faad175b-8bca-42fb-8376-8dc5b2c0c941 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:28.053168 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.policy [None req-faad175b-8bca-42fb-8376-8dc5b2c0c941 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b988bf652b4658acaa6d7b74d37f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bc861de4e4b05b9e798f101735072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=114671) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 08:08:28.060643 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-faad175b-8bca-42fb-8376-8dc5b2c0c941 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 200 len: 1225 microversion: 2.1 time: 0.083653 Aug 30 08:08:28.061219 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 851/1651] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:08:27 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 08:08:29.077619 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-492cf7c1-ebfc-40bf-94ab-2f5343f6db3a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:29.078356 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-492cf7c1-ebfc-40bf-94ab-2f5343f6db3a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:29.084494 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-492cf7c1-ebfc-40bf-94ab-2f5343f6db3a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:29.084949 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-492cf7c1-ebfc-40bf-94ab-2f5343f6db3a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:29.085718 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-492cf7c1-ebfc-40bf-94ab-2f5343f6db3a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:29.086170 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-492cf7c1-ebfc-40bf-94ab-2f5343f6db3a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:29.098880 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-492cf7c1-ebfc-40bf-94ab-2f5343f6db3a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] HTTP exception thrown: Instance 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 could not be found. Aug 30 08:08:29.099463 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-492cf7c1-ebfc-40bf-94ab-2f5343f6db3a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Returning 404 to user: Instance 7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 08:08:29.100272 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-492cf7c1-ebfc-40bf-94ab-2f5343f6db3a tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5" status: 404 len: 111 microversion: 2.1 time: 0.026759 Aug 30 08:08:29.100785 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 801/1652] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:08:29 2021] GET /compute/v2.1/servers/7e1ada03-0d0a-4904-81cc-6a75b3efc8c5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 08:08:29.538456 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e235de81-0a96-4831-8661-57f99ad99af9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:29.538951 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.compute.api [None req-e235de81-0a96-4831-8661-57f99ad99af9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114671) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:29.544677 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e235de81-0a96-4831-8661-57f99ad99af9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:29.545137 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e235de81-0a96-4831-8661-57f99ad99af9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:29.545869 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e235de81-0a96-4831-8661-57f99ad99af9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:29.546360 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG oslo_concurrency.lockutils [None req-e235de81-0a96-4831-8661-57f99ad99af9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:29.559949 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.wsgi [None req-e235de81-0a96-4831-8661-57f99ad99af9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] HTTP exception thrown: Instance d4547bc1-f924-47d7-b393-dc33089c1398 could not be found. Aug 30 08:08:29.560525 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-e235de81-0a96-4831-8661-57f99ad99af9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Returning 404 to user: Instance d4547bc1-f924-47d7-b393-dc33089c1398 could not be found. {{(pid=114671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 08:08:29.561337 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-e235de81-0a96-4831-8661-57f99ad99af9 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 404 len: 111 microversion: 2.1 time: 0.026572 Aug 30 08:08:29.561844 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 852/1653] 10.222.0.73 () {58 vars in 1239 bytes} [Mon Aug 30 08:08:29 2021] DELETE /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 08:08:29.569766 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-34b4b58d-cc53-4c14-9b9a-734b6b375578 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '>' {{(pid=114670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:29.570420 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.compute.api [None req-34b4b58d-cc53-4c14-9b9a-734b6b375578 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] [instance: d4547bc1-f924-47d7-b393-dc33089c1398] Fetching instance by UUID {{(pid=114670) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 30 08:08:29.576139 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34b4b58d-cc53-4c14-9b9a-734b6b375578 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:29.576584 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34b4b58d-cc53-4c14-9b9a-734b6b375578 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:29.577342 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34b4b58d-cc53-4c14-9b9a-734b6b375578 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 30 08:08:29.577779 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG oslo_concurrency.lockutils [None req-34b4b58d-cc53-4c14-9b9a-734b6b375578 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Lock "14de09d5-e436-48df-b23e-2bee56c910cd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 30 08:08:29.590928 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.wsgi [None req-34b4b58d-cc53-4c14-9b9a-734b6b375578 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] HTTP exception thrown: Instance d4547bc1-f924-47d7-b393-dc33089c1398 could not be found. Aug 30 08:08:29.591507 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: DEBUG nova.api.openstack.wsgi [None req-34b4b58d-cc53-4c14-9b9a-734b6b375578 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Returning 404 to user: Instance d4547bc1-f924-47d7-b393-dc33089c1398 could not be found. {{(pid=114670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 30 08:08:29.592310 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO nova.api.openstack.requestlog [None req-34b4b58d-cc53-4c14-9b9a-734b6b375578 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398" status: 404 len: 111 microversion: 2.1 time: 0.026205 Aug 30 08:08:29.592815 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: [pid: 114670|app: 0|req: 802/1654] 10.222.0.73 () {58 vars in 1236 bytes} [Mon Aug 30 08:08:29 2021] GET /compute/v2.1/servers/d4547bc1-f924-47d7-b393-dc33089c1398 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 08:08:30.875985 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: DEBUG nova.api.openstack.wsgi [None req-edb22006-6305-42e2-9127-7901206a6a63 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] Calling method '.version_select at 0x7f341c253d30>' {{(pid=114671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 08:08:30.897579 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO nova.api.openstack.requestlog [None req-edb22006-6305-42e2-9127-7901206a6a63 tempest-TestVolumeBootPattern-775619738 tempest-TestVolumeBootPattern-775619738-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-465833747" status: 202 len: 0 microversion: 2.1 time: 0.025247 Aug 30 08:08:30.898166 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: [pid: 114671|app: 0|req: 853/1655] 10.222.0.73 () {58 vars in 1260 bytes} [Mon Aug 30 08:08:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-465833747 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 08:09:33.905543 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 08:09:33.906073 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: Mon Aug 30 08:09:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 08:09:34.701962 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 08:09:34.702215 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: Mon Aug 30 08:09:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 08:11:10.939028 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 08:11:10.939552 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: Mon Aug 30 08:11:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 08:11:12.845604 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 08:11:12.846192 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: Mon Aug 30 08:11:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 08:11:25.704870 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 08:11:25.705528 dv-cinder-806191-3-iscsi devstack@n-api.service[114671]: Mon Aug 30 08:11:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 08:11:29.840028 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 08:11:29.840593 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: Mon Aug 30 08:11:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 08:12:53.923310 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 08:12:53.924015 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: Mon Aug 30 08:12:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 30 08:12:54.719992 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 08:12:54.720223 dv-cinder-806191-3-iscsi devstack@n-api.service[114670]: Mon Aug 30 08:12:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!